2024-09-12T02:24:14.932 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:24:14.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:24:15.047 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-flush} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901628' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrLqqeZcPdqdTqXQ2wCgkiP7Sxj4/atl7s2lXc/75A4nT2s17ndRXEh2Qo+73Oz2ea2NeIFVchNRgWez/WnKQU= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4sQKls8YuxoiK8uRfQYXT+9GXi2ah3eSz6pbS31vmWezVevjbmtz5BwfpdL8QN7XwT2LJonvGVOcj3LO7jpaY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:24:15.048 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:24:15.048 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:24:15.049 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:24:15.050 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:24:15.076 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:24:15.076 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:24:15.077 INFO:teuthology.packaging:ref: None 2024-09-12T02:24:15.077 INFO:teuthology.packaging:tag: None 2024-09-12T02:24:15.077 INFO:teuthology.packaging:branch: squid 2024-09-12T02:24:15.077 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:24:15.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:24:15.326 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:24:15.327 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:24:15.333 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:24:15.334 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:24:15.349 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:24:15.373 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:24:15.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:24:15.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:19:11.383394', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrLqqeZcPdqdTqXQ2wCgkiP7Sxj4/atl7s2lXc/75A4nT2s17ndRXEh2Qo+73Oz2ea2NeIFVchNRgWez/WnKQU='} 2024-09-12T02:24:15.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:19:11.381941', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4sQKls8YuxoiK8uRfQYXT+9GXi2ah3eSz6pbS31vmWezVevjbmtz5BwfpdL8QN7XwT2LJonvGVOcj3LO7jpaY='} 2024-09-12T02:24:15.447 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:24:15.452 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T02:24:15.453 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T02:24:15.453 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:24:15.513 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd72e72bbe0>, signals=[15]) 2024-09-12T02:24:15.514 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:24:15.519 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:24:15.520 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:24:15.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:24:15.599 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:24:15.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:24:15.676 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:24:15.683 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-12T02:24:15.700 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-12T02:24:15.701 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-12T02:24:15.758 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:24:15.759 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:24:15.759 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:24:15.759 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:24:15.759 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:24:15.759 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:24:15.759 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-12T02:24:15.786 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-12T02:24:15.804 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-12T02:24:15.804 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-12T02:24:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-09-12T02:24:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-09-12T02:24:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-09-12T02:24:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:24:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:24:15.865 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-12T02:24:15.894 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:24:15.902 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:24:15.908 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:24:15.908 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:24:15.911 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:24:15.927 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:24:15.933 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:24:15.933 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:24:15.967 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:24:16.069 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:24:16.125 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:24:16.143 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:24:16.143 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-12T02:24:16.143 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-12T02:24:16.144 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:24:16.144 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:24:16.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:24:16.163 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-12T02:24:16.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:24:16.164 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T02:24:16.220 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:24:16.221 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-503.el9.x86_64 2024-09-12T02:24:16.221 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-09-12T02:24:16.222 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:24:16.222 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.14.0-503.el9.x86_64 2024-09-12T02:24:16.222 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2024-09-12T02:24:18.508 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T02:24:18.591 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T02:24:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-12T02:24:22.041 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-12T02:24:24.768 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-12T02:24:26.393 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-12T02:24:27.464 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T02:24:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-12T02:24:29.416 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T02:24:32.795 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T02:24:34.776 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:24:34.776 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:24:34.863 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-12T02:24:34.869 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T02:24:34.873 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-12T02:24:34.873 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-12T02:24:34.874 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:24:34.875 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 79 M 2024-09-12T02:24:34.875 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 126 M 2024-09-12T02:24:34.875 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-12T02:24:35.521 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-12T02:24:36.588 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.8 MB/s | 16 MB 00:01 2024-09-12T02:24:36.867 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:24:36.867 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:24:36.961 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T02:24:36.971 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T02:24:36.972 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2024-09-12T02:24:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:24:36.972 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 79 M 2024-09-12T02:24:36.972 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 126 M 2024-09-12T02:24:36.972 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T02:24:37.104 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 262 kB/s | 23 kB 00:00 2024-09-12T02:24:37.196 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-12T02:24:37.479 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-12T02:24:37.854 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-12T02:24:37.938 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-12T02:24:37.939 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:24:37.939 INFO:teuthology.orchestra.run.smithi119.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-12T02:24:38.163 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T02:24:38.163 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:24:38.163 INFO:teuthology.orchestra.run.smithi153.stdout:Total 66 MB/s | 79 MB 00:01 2024-09-12T02:24:38.617 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-12T02:24:38.839 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T02:24:38.983 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-12T02:24:38.983 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-12T02:24:39.204 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T02:24:39.204 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T02:24:39.912 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-12T02:24:39.913 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-12T02:24:40.146 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T02:24:40.146 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T02:24:42.382 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-12T02:24:42.610 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T02:24:43.076 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:24:43.158 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:24:43.339 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:24:43.423 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:24:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:24:46.086 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:24:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:24:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:24:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:24:51.002 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:24:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:24:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:24:55.836 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:24:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:33.866 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:33.907 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:34.281 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:34.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:25:34.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:25:34.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:25:34.395 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:34.435 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:34.788 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:34.788 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:25:34.788 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:25:34.788 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.147 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.148 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.148 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:25:35.148 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-12T02:25:35.495 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:25:35.586 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.587 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:25:35.587 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:25:35.587 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:25:35.587 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:25:35.587 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T02:25:35.587 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:25:35.587 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:25:35.622 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:25:35.622 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:25:35.622 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T02:25:35.622 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.623 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.623 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.623 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.623 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:25:35.623 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T02:25:35.647 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:35.647 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:25:35.648 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-09-12T02:25:35.679 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-09-12T02:25:35.680 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-09-12T02:25:35.681 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:25:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:25:35.683 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:25:35.683 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:25:35.683 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:25:35.984 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:25:36.072 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:36.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:25:36.073 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:25:36.073 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:25:36.073 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:25:36.073 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-12T02:25:36.073 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:25:36.073 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:25:36.131 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:25:36.132 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:25:36.132 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 82.el9 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8274670 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:25:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-09-12T02:25:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:25:36.170 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:25:36.173 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:25:36.173 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:25:36.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:25:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-12T02:25:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-12T02:25:37.697 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:25:37.734 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-12T02:25:37.736 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T02:25:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.VtAnG7ynjf 2024-09-12T02:25:37.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VtAnG7ynjf 2024-09-12T02:25:37.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.VtAnG7ynjf 2024-09-12T02:25:37.956 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.VtAnG7ynjf is 6KB 2024-09-12T02:25:37.976 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.VtAnG7ynjf 2024-09-12T02:25:37.991 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:25:38.054 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:25:38.055 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:25:38.055 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:25:38.055 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:25:38.056 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:25:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:25:38.147 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-12T02:25:38.149 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T02:25:38.165 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.k2Vr0xU74a 2024-09-12T02:25:38.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k2Vr0xU74a 2024-09-12T02:25:38.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-12T02:25:38.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.k2Vr0xU74a 2024-09-12T02:25:38.380 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.k2Vr0xU74a is 6KB 2024-09-12T02:25:38.430 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.k2Vr0xU74a 2024-09-12T02:25:38.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:25:38.507 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:25:38.508 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:25:38.508 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:25:38.508 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:25:38.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:25:38.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-12T02:26:08.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:26:08.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:26:08.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:08.662 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-12T02:26:08.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:26:08.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:26.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-12T02:26:27.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T02:26:35.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:26:35.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:36.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:26:36.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:38.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-12T02:26:39.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T02:26:50.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:26:50.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:51.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:26:51.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:27:09.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T02:27:22.631 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-12T02:27:22.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:27:22.961 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:27:22.961 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-12T02:27:22.976 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:27:22.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:27:22.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:27:22.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:27:23.978 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:24.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:27:24.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:27:24.906 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T02:27:25.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:27:25.268 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:27:25.268 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T02:27:25.283 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:27:25.283 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:27:25.284 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:27:25.284 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:27:26.285 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:26.285 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:27:26.294 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:27:26.294 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:27:26.297 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:27:26.314 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:27:26.323 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:27:26.330 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:27:26.330 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:27:26.356 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:27:26.387 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:27:26.395 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:27:26.395 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:27:26.423 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:27:26.488 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:27:26.528 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:27:26.530 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:27:26.575 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:27:26.577 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:27:26.584 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:27:26.584 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:27:26.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:27:26.612 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:27:26.622 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:27:26.622 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:27:26.654 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:27:26.670 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:27:26.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:27:26.804 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:27:26.887 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:27:26.929 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:27:26.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:27:26.996 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:27:27.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:27:27.086 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:27:27.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:27:27.207 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:27:27.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:27:27.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-12T02:27:27.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-12T02:27:27.313 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:27:27.359 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:27:27.838 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:27:27.846 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:27:27.846 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:27:27.862 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:27:27.870 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:27:27.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-12T02:27:27.921 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-12T02:27:27.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-09-12T02:27:28.003 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-09-12T02:27:28.005 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:27:28.005 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-12T02:27:28.028 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-12T02:27:28.028 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-09-12T02:27:28.051 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-09-12T02:27:28.051 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:27:28.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:27:28.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:27:28.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:27:28.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:27:28.135 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:27:28.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:27:28.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:27:28.204 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:27:28.214 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:27:28.218 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:27:28.329 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:27:28.340 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:27:28.341 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:31:11.320 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-12T02:31:11.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:31:11.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:31:11.425 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-12T02:31:11.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:31:11.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:31:11.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:31:11.580 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T02:31:11.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T02:31:11.662 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:31:11.671 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:31:11.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:31:11.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:31:11.673 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:31:11.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:31:11.715 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:31:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:31:11.739 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-12T02:31:11.748 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:31:11.751 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-12T02:31:11.765 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:31:11.774 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-09-12T02:31:11.779 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:31:11.785 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-09-12T02:31:11.799 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:31:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:31:11.846 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:31:11.850 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:31:11.850 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-12T02:31:11.850 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.850 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.850 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.851 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.867 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:31:11.872 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:31:11.872 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-12T02:31:11.872 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.872 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.873 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.873 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:31:11.873 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:31:11.882 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:31:11.882 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:31:11.882 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:31:11.882 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:31:11.888 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:31:11.888 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:31:11.888 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:31:11.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:31:11.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:31:11.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:31:12.039 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:31:12.039 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:31:12.042 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:31:12.042 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:31:12.149 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:31:12.150 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:31:12.150 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:31:12.156 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:31:12.157 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:31:12.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:31:12.176 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:31:12.176 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:31:12.183 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:31:12.183 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:31:12.241 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:31:12.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:31:12.316 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:31:12.325 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:31:12.380 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-12T02:31:12.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-12T02:31:12.389 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-09-12T02:31:12.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-09-12T02:31:12.612 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-12T02:31:12.638 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:31:12.649 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-09-12T02:31:12.676 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:31:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-12T02:31:13.234 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-12T02:31:13.472 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:31:13.527 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T02:31:13.747 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:31:13.811 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T02:31:16.694 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-12T02:31:17.613 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-09-12T02:31:18.778 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T02:31:21.797 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-12T02:31:25.103 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-12T02:31:26.671 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 19 kB 00:00 2024-09-12T02:31:27.356 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T02:31:27.550 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T02:31:28.757 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 19 kB 00:00 2024-09-12T02:31:29.819 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T02:31:33.014 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T02:31:35.192 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-12T02:31:35.343 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:31:35.344 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:31:35.358 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:31:35.359 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:31:35.360 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:31:35.361 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:31:35.363 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:31:35.365 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:31:35.366 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:31:35.432 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T02:31:35.454 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:31:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:31:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:31:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:31:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:31:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:31:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:31:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:31:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:31:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:31:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:31:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:31:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:31:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:31:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:31:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:31:35.470 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Install 148 Packages 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 8 Packages 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 226 M 2024-09-12T02:31:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T02:31:36.090 INFO:teuthology.orchestra.run.smithi153.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T02:31:36.349 INFO:teuthology.orchestra.run.smithi153.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.4 MB/s | 897 kB 00:00 2024-09-12T02:31:36.432 INFO:teuthology.orchestra.run.smithi153.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T02:31:36.457 INFO:teuthology.orchestra.run.smithi153.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-12T02:31:36.549 INFO:teuthology.orchestra.run.smithi153.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-12T02:31:36.766 INFO:teuthology.orchestra.run.smithi153.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-12T02:31:36.808 INFO:teuthology.orchestra.run.smithi153.stdout:(7/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 1.5 MB 00:00 2024-09-12T02:31:37.225 INFO:teuthology.orchestra.run.smithi153.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:31:37.275 INFO:teuthology.orchestra.run.smithi153.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 508 kB/s | 25 kB 00:00 2024-09-12T02:31:37.561 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:31:37.561 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:31:37.573 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:31:37.573 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:31:37.574 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:31:37.575 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:31:37.577 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:31:37.579 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:31:37.580 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:31:37.592 INFO:teuthology.orchestra.run.smithi153.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 20 MB/s | 17 MB 00:00 2024-09-12T02:31:37.642 INFO:teuthology.orchestra.run.smithi153.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:31:37.644 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:31:37.657 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:31:37.658 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:31:37.659 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:31:37.660 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:31:37.661 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:31:37.662 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:31:37.663 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:31:37.664 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:31:37.665 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:31:37.666 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:31:37.667 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:31:37.668 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:31:37.669 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:Install 148 Packages 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:31:37.670 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 226 M 2024-09-12T02:31:37.671 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-12T02:31:37.709 INFO:teuthology.orchestra.run.smithi153.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-12T02:31:37.768 INFO:teuthology.orchestra.run.smithi153.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 547 kB/s | 32 kB 00:00 2024-09-12T02:31:37.868 INFO:teuthology.orchestra.run.smithi153.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-12T02:31:37.918 INFO:teuthology.orchestra.run.smithi153.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-12T02:31:37.977 INFO:teuthology.orchestra.run.smithi153.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T02:31:38.044 INFO:teuthology.orchestra.run.smithi153.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T02:31:38.153 INFO:teuthology.orchestra.run.smithi153.stdout:(18/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.9 MB/s | 11 MB 00:01 2024-09-12T02:31:38.195 INFO:teuthology.orchestra.run.smithi153.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.1 MB/s | 45 kB 00:00 2024-09-12T02:31:38.312 INFO:teuthology.orchestra.run.smithi153.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-12T02:31:38.337 INFO:teuthology.orchestra.run.smithi153.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 958 kB/s | 136 kB 00:00 2024-09-12T02:31:38.362 INFO:teuthology.orchestra.run.smithi153.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T02:31:38.368 INFO:teuthology.orchestra.run.smithi119.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-09-12T02:31:38.387 INFO:teuthology.orchestra.run.smithi153.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:31:38.413 INFO:teuthology.orchestra.run.smithi153.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.8 MB/s | 301 kB 00:00 2024-09-12T02:31:38.438 INFO:teuthology.orchestra.run.smithi153.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:31:38.463 INFO:teuthology.orchestra.run.smithi153.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:31:38.547 INFO:teuthology.orchestra.run.smithi153.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T02:31:38.656 INFO:teuthology.orchestra.run.smithi153.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 294 kB/s | 32 kB 00:00 2024-09-12T02:31:38.756 INFO:teuthology.orchestra.run.smithi153.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T02:31:38.852 INFO:teuthology.orchestra.run.smithi119.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.3 MB/s | 5.4 MB 00:00 2024-09-12T02:31:38.952 INFO:teuthology.orchestra.run.smithi119.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.4 MB/s | 145 kB 00:00 2024-09-12T02:31:39.040 INFO:teuthology.orchestra.run.smithi153.stdout:(30/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi153.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.5 MB/s | 3.1 MB 00:00 2024-09-12T02:31:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-12T02:31:39.215 INFO:teuthology.orchestra.run.smithi153.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T02:31:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 493 kB/s | 49 kB 00:00 2024-09-12T02:31:39.353 INFO:teuthology.orchestra.run.smithi119.stdout:(5/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 912 kB/s | 897 kB 00:00 2024-09-12T02:31:39.394 INFO:teuthology.orchestra.run.smithi119.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-12T02:31:39.399 INFO:teuthology.orchestra.run.smithi153.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T02:31:39.628 INFO:teuthology.orchestra.run.smithi119.stdout:(7/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-12T02:31:39.866 INFO:teuthology.orchestra.run.smithi153.stdout:(35/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T02:31:39.891 INFO:teuthology.orchestra.run.smithi153.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 579 kB/s | 285 kB 00:00 2024-09-12T02:31:39.975 INFO:teuthology.orchestra.run.smithi153.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-12T02:31:40.000 INFO:teuthology.orchestra.run.smithi153.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 168 kB/s | 18 kB 00:00 2024-09-12T02:31:40.042 INFO:teuthology.orchestra.run.smithi153.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-12T02:31:40.120 INFO:teuthology.orchestra.run.smithi119.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 22 MB/s | 11 MB 00:00 2024-09-12T02:31:40.162 INFO:teuthology.orchestra.run.smithi119.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 606 kB/s | 25 kB 00:00 2024-09-12T02:31:40.184 INFO:teuthology.orchestra.run.smithi153.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 383 kB/s | 80 kB 00:00 2024-09-12T02:31:40.234 INFO:teuthology.orchestra.run.smithi153.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2024-09-12T02:31:40.301 INFO:teuthology.orchestra.run.smithi153.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-12T02:31:40.320 INFO:teuthology.orchestra.run.smithi119.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 18 MB/s | 17 MB 00:00 2024-09-12T02:31:40.326 INFO:teuthology.orchestra.run.smithi153.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-12T02:31:40.351 INFO:teuthology.orchestra.run.smithi153.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:31:40.371 INFO:teuthology.orchestra.run.smithi119.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:31:40.385 INFO:teuthology.orchestra.run.smithi153.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T02:31:40.410 INFO:teuthology.orchestra.run.smithi153.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T02:31:40.429 INFO:teuthology.orchestra.run.smithi119.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 465 kB/s | 27 kB 00:00 2024-09-12T02:31:40.444 INFO:teuthology.orchestra.run.smithi153.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-12T02:31:40.478 INFO:teuthology.orchestra.run.smithi153.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T02:31:40.488 INFO:teuthology.orchestra.run.smithi119.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 542 kB/s | 32 kB 00:00 2024-09-12T02:31:40.563 INFO:teuthology.orchestra.run.smithi119.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T02:31:40.630 INFO:teuthology.orchestra.run.smithi119.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:31:40.697 INFO:teuthology.orchestra.run.smithi119.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T02:31:40.772 INFO:teuthology.orchestra.run.smithi119.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T02:31:41.089 INFO:teuthology.orchestra.run.smithi119.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-12T02:31:41.145 INFO:teuthology.orchestra.run.smithi153.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-12T02:31:41.148 INFO:teuthology.orchestra.run.smithi119.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 774 kB/s | 45 kB 00:00 2024-09-12T02:31:41.215 INFO:teuthology.orchestra.run.smithi119.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T02:31:41.270 INFO:teuthology.orchestra.run.smithi153.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 802 kB/s | 689 kB 00:00 2024-09-12T02:31:41.281 INFO:teuthology.orchestra.run.smithi119.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T02:31:41.337 INFO:teuthology.orchestra.run.smithi153.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-12T02:31:41.365 INFO:teuthology.orchestra.run.smithi119.stdout:(22/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86 2.3 MB/s | 4.7 MB 00:02 2024-09-12T02:31:41.399 INFO:teuthology.orchestra.run.smithi119.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 321 kB 00:00 2024-09-12T02:31:41.449 INFO:teuthology.orchestra.run.smithi119.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 100 kB 00:00 2024-09-12T02:31:41.483 INFO:teuthology.orchestra.run.smithi119.stdout:(25/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.5 MB/s | 301 kB 00:00 2024-09-12T02:31:41.508 INFO:teuthology.orchestra.run.smithi119.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T02:31:41.558 INFO:teuthology.orchestra.run.smithi119.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T02:31:41.712 INFO:teuthology.orchestra.run.smithi153.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-12T02:31:41.896 INFO:teuthology.orchestra.run.smithi153.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T02:31:41.976 INFO:teuthology.orchestra.run.smithi119.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 27 MB/s | 49 MB 00:01 2024-09-12T02:31:41.992 INFO:teuthology.orchestra.run.smithi119.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 73 kB/s | 32 kB 00:00 2024-09-12T02:31:42.026 INFO:teuthology.orchestra.run.smithi119.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T02:31:42.168 INFO:teuthology.orchestra.run.smithi119.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 20 MB/s | 3.6 MB 00:00 2024-09-12T02:31:42.179 INFO:teuthology.orchestra.run.smithi153.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 345 kB/s | 313 kB 00:00 2024-09-12T02:31:42.218 INFO:teuthology.orchestra.run.smithi119.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T02:31:42.277 INFO:teuthology.orchestra.run.smithi119.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 847 kB/s | 49 kB 00:00 2024-09-12T02:31:42.360 INFO:teuthology.orchestra.run.smithi119.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 22 MB/s | 7.4 MB 00:00 2024-09-12T02:31:42.371 INFO:teuthology.orchestra.run.smithi153.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-12T02:31:42.386 INFO:teuthology.orchestra.run.smithi119.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 151 kB/s | 16 kB 00:00 2024-09-12T02:31:42.411 INFO:teuthology.orchestra.run.smithi119.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T02:31:42.453 INFO:teuthology.orchestra.run.smithi119.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi119.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T02:31:42.529 INFO:teuthology.orchestra.run.smithi119.stdout:(39/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 3.0 MB/s | 3.1 MB 00:01 2024-09-12T02:31:42.629 INFO:teuthology.orchestra.run.smithi119.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-12T02:31:42.655 INFO:teuthology.orchestra.run.smithi153.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T02:31:42.687 INFO:teuthology.orchestra.run.smithi119.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T02:31:42.737 INFO:teuthology.orchestra.run.smithi119.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T02:31:42.788 INFO:teuthology.orchestra.run.smithi119.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:31:42.855 INFO:teuthology.orchestra.run.smithi119.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-12T02:31:42.880 INFO:teuthology.orchestra.run.smithi119.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T02:31:43.005 INFO:teuthology.orchestra.run.smithi119.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-12T02:31:43.033 INFO:teuthology.orchestra.run.smithi119.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 712 kB/s | 125 kB 00:00 2024-09-12T02:31:43.033 INFO:teuthology.orchestra.run.smithi153.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-09-12T02:31:43.064 INFO:teuthology.orchestra.run.smithi119.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-12T02:31:43.155 INFO:teuthology.orchestra.run.smithi153.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-12T02:31:43.206 INFO:teuthology.orchestra.run.smithi119.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-12T02:31:43.239 INFO:teuthology.orchestra.run.smithi153.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-12T02:31:43.239 INFO:teuthology.orchestra.run.smithi119.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-12T02:31:43.265 INFO:teuthology.orchestra.run.smithi119.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-12T02:31:43.299 INFO:teuthology.orchestra.run.smithi119.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-12T02:31:43.324 INFO:teuthology.orchestra.run.smithi119.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-12T02:31:43.349 INFO:teuthology.orchestra.run.smithi119.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T02:31:43.374 INFO:teuthology.orchestra.run.smithi119.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-12T02:31:43.400 INFO:teuthology.orchestra.run.smithi119.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 220 kB/s | 11 kB 00:00 2024-09-12T02:31:43.425 INFO:teuthology.orchestra.run.smithi119.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T02:31:43.450 INFO:teuthology.orchestra.run.smithi119.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-12T02:31:43.509 INFO:teuthology.orchestra.run.smithi119.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-12T02:31:43.542 INFO:teuthology.orchestra.run.smithi119.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-12T02:31:43.568 INFO:teuthology.orchestra.run.smithi119.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T02:31:43.593 INFO:teuthology.orchestra.run.smithi119.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T02:31:43.627 INFO:teuthology.orchestra.run.smithi119.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T02:31:43.652 INFO:teuthology.orchestra.run.smithi119.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T02:31:43.677 INFO:teuthology.orchestra.run.smithi119.stdout:(65/156): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi119.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-09-12T02:31:43.761 INFO:teuthology.orchestra.run.smithi119.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-12T02:31:43.772 INFO:teuthology.orchestra.run.smithi153.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-12T02:31:43.836 INFO:teuthology.orchestra.run.smithi119.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-12T02:31:43.878 INFO:teuthology.orchestra.run.smithi119.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi119.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T02:31:43.954 INFO:teuthology.orchestra.run.smithi119.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-12T02:31:43.987 INFO:teuthology.orchestra.run.smithi119.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-12T02:31:44.012 INFO:teuthology.orchestra.run.smithi119.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi153.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 652 kB/s | 662 kB 00:01 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi119.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T02:31:44.072 INFO:teuthology.orchestra.run.smithi153.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 633 kB/s | 581 kB 00:00 2024-09-12T02:31:44.190 INFO:teuthology.orchestra.run.smithi119.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-12T02:31:44.230 INFO:teuthology.orchestra.run.smithi119.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-12T02:31:44.255 INFO:teuthology.orchestra.run.smithi119.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-09-12T02:31:44.281 INFO:teuthology.orchestra.run.smithi119.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-12T02:31:44.306 INFO:teuthology.orchestra.run.smithi119.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T02:31:44.331 INFO:teuthology.orchestra.run.smithi119.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T02:31:44.357 INFO:teuthology.orchestra.run.smithi119.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T02:31:44.381 INFO:teuthology.orchestra.run.smithi153.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 78 kB/s | 47 kB 00:00 2024-09-12T02:31:44.432 INFO:teuthology.orchestra.run.smithi119.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-12T02:31:44.457 INFO:teuthology.orchestra.run.smithi119.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T02:31:44.482 INFO:teuthology.orchestra.run.smithi119.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T02:31:44.507 INFO:teuthology.orchestra.run.smithi119.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T02:31:44.533 INFO:teuthology.orchestra.run.smithi119.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-12T02:31:44.558 INFO:teuthology.orchestra.run.smithi119.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T02:31:44.583 INFO:teuthology.orchestra.run.smithi119.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T02:31:44.617 INFO:teuthology.orchestra.run.smithi119.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T02:31:44.642 INFO:teuthology.orchestra.run.smithi119.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-12T02:31:44.667 INFO:teuthology.orchestra.run.smithi119.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T02:31:44.751 INFO:teuthology.orchestra.run.smithi119.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T02:31:44.776 INFO:teuthology.orchestra.run.smithi119.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-12T02:31:44.798 INFO:teuthology.orchestra.run.smithi153.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-12T02:31:44.802 INFO:teuthology.orchestra.run.smithi119.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-12T02:31:44.823 INFO:teuthology.orchestra.run.smithi153.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 377 kB/s | 292 kB 00:00 2024-09-12T02:31:44.827 INFO:teuthology.orchestra.run.smithi119.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:31:44.852 INFO:teuthology.orchestra.run.smithi119.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-12T02:31:44.881 INFO:teuthology.orchestra.run.smithi119.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T02:31:44.903 INFO:teuthology.orchestra.run.smithi119.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T02:31:44.928 INFO:teuthology.orchestra.run.smithi119.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:31:44.931 INFO:teuthology.orchestra.run.smithi153.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 70 kB/s | 38 kB 00:00 2024-09-12T02:31:44.953 INFO:teuthology.orchestra.run.smithi119.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:31:44.978 INFO:teuthology.orchestra.run.smithi119.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:31:45.004 INFO:teuthology.orchestra.run.smithi119.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-12T02:31:45.246 INFO:teuthology.orchestra.run.smithi119.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T02:31:45.288 INFO:teuthology.orchestra.run.smithi119.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-12T02:31:45.338 INFO:teuthology.orchestra.run.smithi119.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-12T02:31:45.363 INFO:teuthology.orchestra.run.smithi119.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-09-12T02:31:45.397 INFO:teuthology.orchestra.run.smithi119.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-12T02:31:45.414 INFO:teuthology.orchestra.run.smithi119.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-12T02:31:45.430 INFO:teuthology.orchestra.run.smithi119.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T02:31:45.456 INFO:teuthology.orchestra.run.smithi119.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:31:45.493 INFO:teuthology.orchestra.run.smithi119.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T02:31:45.540 INFO:teuthology.orchestra.run.smithi119.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi119.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T02:31:45.615 INFO:teuthology.orchestra.run.smithi119.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:31:45.641 INFO:teuthology.orchestra.run.smithi119.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:31:45.666 INFO:teuthology.orchestra.run.smithi119.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi119.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T02:31:45.767 INFO:teuthology.orchestra.run.smithi119.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-12T02:31:45.792 INFO:teuthology.orchestra.run.smithi119.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T02:31:45.817 INFO:teuthology.orchestra.run.smithi119.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T02:31:45.842 INFO:teuthology.orchestra.run.smithi119.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:31:45.876 INFO:teuthology.orchestra.run.smithi119.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:31:45.901 INFO:teuthology.orchestra.run.smithi119.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T02:31:45.907 INFO:teuthology.orchestra.run.smithi153.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-12T02:31:45.926 INFO:teuthology.orchestra.run.smithi119.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-12T02:31:45.952 INFO:teuthology.orchestra.run.smithi119.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-12T02:31:45.974 INFO:teuthology.orchestra.run.smithi153.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-12T02:31:45.977 INFO:teuthology.orchestra.run.smithi119.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T02:31:46.002 INFO:teuthology.orchestra.run.smithi119.stdout:(127/156): protobuf-compiler-3.14.0-13.el9.x86_ 865 kB/s | 863 kB 00:00 2024-09-12T02:31:46.015 INFO:teuthology.orchestra.run.smithi153.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-12T02:31:46.028 INFO:teuthology.orchestra.run.smithi119.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T02:31:46.061 INFO:teuthology.orchestra.run.smithi119.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:31:46.086 INFO:teuthology.orchestra.run.smithi119.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2024-09-12T02:31:46.128 INFO:teuthology.orchestra.run.smithi119.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-09-12T02:31:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-12T02:31:46.179 INFO:teuthology.orchestra.run.smithi119.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-12T02:31:46.204 INFO:teuthology.orchestra.run.smithi119.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:31:46.229 INFO:teuthology.orchestra.run.smithi119.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T02:31:46.255 INFO:teuthology.orchestra.run.smithi119.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-12T02:31:46.280 INFO:teuthology.orchestra.run.smithi119.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-12T02:31:46.305 INFO:teuthology.orchestra.run.smithi119.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:31:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:31:46.356 INFO:teuthology.orchestra.run.smithi119.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-12T02:31:46.381 INFO:teuthology.orchestra.run.smithi119.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:31:46.406 INFO:teuthology.orchestra.run.smithi119.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:31:46.432 INFO:teuthology.orchestra.run.smithi119.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:31:46.465 INFO:teuthology.orchestra.run.smithi119.stdout:(144/156): python3-kubernetes-26.1.0-2.el9.noar 2.2 MB/s | 1.0 MB 00:00 2024-09-12T02:31:46.491 INFO:teuthology.orchestra.run.smithi119.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-12T02:31:46.516 INFO:teuthology.orchestra.run.smithi119.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:31:46.541 INFO:teuthology.orchestra.run.smithi119.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T02:31:46.592 INFO:teuthology.orchestra.run.smithi119.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:31:46.674 INFO:teuthology.orchestra.run.smithi153.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-12T02:31:46.841 INFO:teuthology.orchestra.run.smithi153.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-09-12T02:31:46.909 INFO:teuthology.orchestra.run.smithi119.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 8.6 MB/s | 3.2 MB 00:00 2024-09-12T02:31:47.175 INFO:teuthology.orchestra.run.smithi153.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-12T02:31:47.175 INFO:teuthology.orchestra.run.smithi119.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 3.4 MB 00:00 2024-09-12T02:31:47.284 INFO:teuthology.orchestra.run.smithi119.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 377 kB/s | 41 kB 00:00 2024-09-12T02:31:47.418 INFO:teuthology.orchestra.run.smithi119.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-12T02:31:47.451 INFO:teuthology.orchestra.run.smithi119.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 3.3 MB/s | 1.8 MB 00:00 2024-09-12T02:31:47.533 INFO:teuthology.orchestra.run.smithi153.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 126 kB/s | 87 kB 00:00 2024-09-12T02:31:47.650 INFO:teuthology.orchestra.run.smithi153.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-12T02:31:47.785 INFO:teuthology.orchestra.run.smithi119.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 1.4 MB 00:00 2024-09-12T02:31:47.993 INFO:teuthology.orchestra.run.smithi119.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 2.4 MB 00:00 2024-09-12T02:31:48.242 INFO:teuthology.orchestra.run.smithi153.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 86 kB/s | 61 kB 00:00 2024-09-12T02:31:48.417 INFO:teuthology.orchestra.run.smithi153.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-12T02:31:48.501 INFO:teuthology.orchestra.run.smithi153.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 288 kB/s | 245 kB 00:00 2024-09-12T02:31:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-12T02:31:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-12T02:31:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-09-12T02:31:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-09-12T02:31:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 220 kB/s | 172 kB 00:00 2024-09-12T02:31:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-12T02:31:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 327 kB/s | 250 kB 00:00 2024-09-12T02:31:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 259 kB/s | 222 kB 00:00 2024-09-12T02:31:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-09-12T02:31:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-12T02:31:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 305 kB/s | 269 kB 00:00 2024-09-12T02:31:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 195 kB/s | 159 kB 00:00 2024-09-12T02:31:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 315 kB/s | 279 kB 00:00 2024-09-12T02:31:51.985 INFO:teuthology.orchestra.run.smithi119.stdout:(156/156): NetworkManager-1.49.90-1.el9.x86_64. 441 kB/s | 2.3 MB 00:05 2024-09-12T02:31:52.009 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:31:52.009 INFO:teuthology.orchestra.run.smithi119.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi153.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-09-12T02:31:52.379 INFO:teuthology.orchestra.run.smithi153.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 82 kB/s | 54 kB 00:00 2024-09-12T02:31:52.763 INFO:teuthology.orchestra.run.smithi153.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 66 kB/s | 42 kB 00:00 2024-09-12T02:31:53.013 INFO:teuthology.orchestra.run.smithi153.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 71 kB/s | 44 kB 00:00 2024-09-12T02:31:53.232 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-12T02:31:53.384 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-12T02:31:53.384 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-12T02:31:53.588 INFO:teuthology.orchestra.run.smithi153.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 268 kB/s | 221 kB 00:00 2024-09-12T02:31:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 61 kB/s | 36 kB 00:00 2024-09-12T02:31:54.172 INFO:teuthology.orchestra.run.smithi153.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-12T02:31:54.497 INFO:teuthology.orchestra.run.smithi153.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-09-12T02:31:54.531 INFO:teuthology.orchestra.run.smithi153.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 332 kB/s | 304 kB 00:00 2024-09-12T02:31:54.923 INFO:teuthology.orchestra.run.smithi153.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 77 kB/s | 58 kB 00:00 2024-09-12T02:31:55.165 INFO:teuthology.orchestra.run.smithi153.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 146 kB/s | 96 kB 00:00 2024-09-12T02:31:55.206 INFO:teuthology.orchestra.run.smithi153.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 94 kB/s | 64 kB 00:00 2024-09-12T02:31:55.265 INFO:teuthology.orchestra.run.smithi153.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-12T02:31:55.324 INFO:teuthology.orchestra.run.smithi153.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:31:55.349 INFO:teuthology.orchestra.run.smithi153.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T02:31:55.374 INFO:teuthology.orchestra.run.smithi153.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-12T02:31:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-12T02:31:55.450 INFO:teuthology.orchestra.run.smithi153.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-09-12T02:31:55.467 INFO:teuthology.orchestra.run.smithi153.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T02:31:55.492 INFO:teuthology.orchestra.run.smithi153.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:31:55.526 INFO:teuthology.orchestra.run.smithi153.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T02:31:55.551 INFO:teuthology.orchestra.run.smithi153.stdout:(112/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-12T02:31:55.626 INFO:teuthology.orchestra.run.smithi153.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T02:31:55.651 INFO:teuthology.orchestra.run.smithi153.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-12T02:31:55.653 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-12T02:31:55.654 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-12T02:31:55.676 INFO:teuthology.orchestra.run.smithi153.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:31:55.702 INFO:teuthology.orchestra.run.smithi153.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-12T02:31:55.727 INFO:teuthology.orchestra.run.smithi153.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-12T02:31:55.752 INFO:teuthology.orchestra.run.smithi153.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T02:31:55.778 INFO:teuthology.orchestra.run.smithi153.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-09-12T02:31:55.803 INFO:teuthology.orchestra.run.smithi153.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-12T02:31:55.828 INFO:teuthology.orchestra.run.smithi153.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-12T02:31:55.854 INFO:teuthology.orchestra.run.smithi153.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-12T02:31:55.879 INFO:teuthology.orchestra.run.smithi153.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T02:31:55.904 INFO:teuthology.orchestra.run.smithi153.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:31:55.929 INFO:teuthology.orchestra.run.smithi153.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-12T02:31:55.954 INFO:teuthology.orchestra.run.smithi153.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T02:31:55.980 INFO:teuthology.orchestra.run.smithi153.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T02:31:56.005 INFO:teuthology.orchestra.run.smithi153.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T02:31:56.030 INFO:teuthology.orchestra.run.smithi153.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:31:56.055 INFO:teuthology.orchestra.run.smithi153.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:31:56.081 INFO:teuthology.orchestra.run.smithi153.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:31:56.114 INFO:teuthology.orchestra.run.smithi153.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:31:56.140 INFO:teuthology.orchestra.run.smithi153.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-12T02:31:56.165 INFO:teuthology.orchestra.run.smithi153.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:31:56.199 INFO:teuthology.orchestra.run.smithi153.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T02:31:56.224 INFO:teuthology.orchestra.run.smithi153.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-12T02:31:56.249 INFO:teuthology.orchestra.run.smithi153.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T02:31:56.274 INFO:teuthology.orchestra.run.smithi153.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:31:56.300 INFO:teuthology.orchestra.run.smithi153.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:31:56.325 INFO:teuthology.orchestra.run.smithi153.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T02:31:56.351 INFO:teuthology.orchestra.run.smithi153.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:31:56.376 INFO:teuthology.orchestra.run.smithi153.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:31:56.401 INFO:teuthology.orchestra.run.smithi153.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:31:56.418 INFO:teuthology.orchestra.run.smithi153.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T02:31:56.469 INFO:teuthology.orchestra.run.smithi153.stdout:(145/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-12T02:31:56.485 INFO:teuthology.orchestra.run.smithi153.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T02:31:56.510 INFO:teuthology.orchestra.run.smithi153.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T02:31:56.553 INFO:teuthology.orchestra.run.smithi153.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T02:31:56.745 INFO:teuthology.orchestra.run.smithi153.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 3.2 MB 00:00 2024-09-12T02:31:56.878 INFO:teuthology.orchestra.run.smithi153.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-12T02:31:56.995 INFO:teuthology.orchestra.run.smithi153.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-12T02:31:57.103 INFO:teuthology.orchestra.run.smithi153.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.2 MB/s | 2.3 MB 00:00 2024-09-12T02:31:57.145 INFO:teuthology.orchestra.run.smithi153.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-12T02:31:57.454 INFO:teuthology.orchestra.run.smithi153.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.5 MB/s | 1.8 MB 00:00 2024-09-12T02:31:57.796 INFO:teuthology.orchestra.run.smithi153.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 1.4 MB 00:00 2024-09-12T02:31:57.870 INFO:teuthology.orchestra.run.smithi153.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-12T02:31:57.878 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:31:57.878 INFO:teuthology.orchestra.run.smithi153.stdout:Total 10 MB/s | 226 MB 00:22 2024-09-12T02:31:59.055 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T02:31:59.208 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T02:31:59.209 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T02:32:01.417 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T02:32:01.418 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T02:32:01.879 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-12T02:32:01.997 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:32:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:32:02.289 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:32:02.373 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:32:02.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:32:02.453 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:32:02.787 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:32:02.890 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:03.013 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:03.050 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:03.133 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:03.163 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:32:03.341 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:32:03.392 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:32:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:03.524 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:03.546 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:32:03.609 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:32:03.639 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:32:03.665 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:32:03.883 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:32:04.044 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:32:04.289 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:04.372 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:04.595 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:04.714 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:32:04.808 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:32:04.844 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:32:04.879 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:32:04.943 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:32:04.996 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:32:05.028 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:32:05.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:32:05.105 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:32:05.132 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:32:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:32:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:32:05.285 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:32:05.321 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:32:05.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:32:05.431 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:32:05.475 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:32:05.504 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:32:05.572 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:32:05.617 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:32:05.691 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:32:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:32:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:32:06.395 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:32:06.489 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:32:06.528 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:32:06.571 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:32:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:32:06.651 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:32:06.797 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:32:06.861 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:32:06.916 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:32:06.988 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:32:07.029 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:32:07.065 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:32:07.111 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:32:07.148 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:32:07.191 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:32:07.232 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:32:07.365 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:32:07.410 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:32:07.552 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:32:07.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:32:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:32:07.709 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:32:07.870 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:32:08.016 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:32:08.043 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T02:32:08.143 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:32:08.182 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:32:08.183 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:32:08.210 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:32:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:32:08.246 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:32:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:32:08.283 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:32:08.314 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:32:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:32:08.341 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:32:08.344 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:32:08.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:32:08.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:32:08.404 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:32:08.446 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:32:08.480 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:32:08.567 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:32:08.611 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:32:08.645 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:32:08.748 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:32:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:32:08.796 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:32:08.851 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:08.974 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:09.002 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:09.093 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:09.124 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:32:09.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:32:09.361 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:32:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:09.493 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:09.510 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:32:09.515 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:32:09.568 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:32:09.587 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:32:09.601 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:32:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:32:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:32:09.700 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:32:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:32:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:32:09.810 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:32:09.918 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:32:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:32:09.989 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:32:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:32:10.137 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:32:10.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:32:10.218 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:32:10.290 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:10.516 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:32:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:32:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:32:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:32:10.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:32:10.862 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:32:10.896 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:32:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:32:10.938 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:32:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:32:11.017 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:32:11.018 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:32:11.042 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:32:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:32:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:32:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:32:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:32:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:32:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:32:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:32:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:32:11.498 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:32:11.544 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:32:11.618 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:32:11.751 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:32:11.804 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:32:12.253 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:32:12.326 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:32:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:32:12.377 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:32:12.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:32:12.415 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:32:12.437 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:32:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:32:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:32:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:32:12.722 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:32:12.738 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:32:12.765 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:32:12.821 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:32:12.855 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:32:12.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:32:12.886 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:32:12.916 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:32:12.948 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:32:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:32:13.016 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:32:13.062 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:32:13.098 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:32:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:32:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:32:13.360 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:32:13.391 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:32:13.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:32:13.417 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:32:13.489 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:32:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:32:13.519 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:32:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:32:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:32:13.608 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:32:13.633 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:32:13.731 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:32:13.860 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:32:13.899 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:32:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:32:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:32:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:32:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:32:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:32:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:32:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:32:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:32:14.225 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:32:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:32:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:32:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:32:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:32:14.545 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:32:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:32:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:32:15.359 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:32:15.459 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:32:15.506 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:32:15.550 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:32:15.646 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:32:15.687 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:32:15.820 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:15.857 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:32:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:32:15.979 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:32:16.408 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:16.444 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:32:16.535 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:32:16.535 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:32:16.535 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:32:16.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:16.570 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:32:16.633 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:32:16.758 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:32:18.012 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:32:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:32:18.125 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:32:18.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:32:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:32:18.512 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:32:18.612 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:32:18.642 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:32:18.687 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:32:19.166 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:32:19.190 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:32:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:32:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:32:21.615 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:21.655 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:22.205 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:32:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:32:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:32:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:32:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:32:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:32:28.788 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:32:28.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-12T02:32:28.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-12T02:32:28.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-12T02:32:28.789 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-12T02:32:28.789 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-12T02:32:28.789 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-12T02:32:28.789 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-12T02:32:28.789 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:28.965 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:32:28.980 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:32:28.980 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:28.981 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:32:28.981 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:30.476 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:32:30.502 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:32:30.503 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:30.503 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:32:30.503 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:32:30.503 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:32:30.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:30.735 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:31.194 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:32:31.217 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:31.315 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:32:31.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:32:31.419 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:32:31.605 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:32:31.652 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:32:31.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:32:31.818 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:32:31.957 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:32:32.003 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:32:32.034 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:32:32.062 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:32:32.487 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:32:32.510 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:32:32.542 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:32:32.604 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:32:32.633 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:32:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:32:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-09-12T02:32:33.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:34.053 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:32:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:32:34.069 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:34.069 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:32:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:32:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:32:34.806 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:32:34.965 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:32:34.987 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:32:35.012 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:32:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:32:35.173 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:32:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:32:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:32:35.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:35.798 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:32:35.821 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:32:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:32:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:32:36.265 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:32:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:32:36.272 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:36.273 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:32:36.273 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:32:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:36.317 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:32:36.341 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:32:36.437 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:32:36.491 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:32:36.651 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:32:36.675 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:32:36.675 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:36.675 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:32:36.676 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:32:36.676 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:32:36.676 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:32:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:32:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:32:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:32:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:32:37.091 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:32:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:32:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:32:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:32:37.591 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:32:37.622 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:32:37.685 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:32:37.713 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:32:38.765 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:32:38.815 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:32:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:32:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:32:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:32:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:32:40.117 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:32:40.142 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:40.193 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:32:40.204 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:32:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:32:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:32:41.221 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:32:41.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:32:41.289 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:32:41.303 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:32:41.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:32:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:32:41.345 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:41.345 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:32:41.345 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:32:41.345 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:32:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:41.362 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:32:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:32:41.410 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:32:41.411 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:41.411 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:32:41.411 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:41.455 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:32:41.478 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:32:41.478 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:41.478 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:32:41.478 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:32:41.479 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:32:41.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:41.561 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:32:41.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:32:41.640 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:32:41.669 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:32:41.707 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:32:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:32:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:32:41.804 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:32:41.804 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:32:41.804 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:32:41.804 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:32:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:42.286 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:42.350 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:43.173 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:32:43.259 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:32:43.300 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:32:43.389 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:32:43.429 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:32:43.455 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:32:43.480 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:32:43.480 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:32:43.564 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:32:43.565 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:32:43.648 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:32:43.673 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:32:43.679 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:43.679 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:43.875 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:43.875 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:32:43.942 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:32:44.008 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:46.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:32:46.442 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:32:46.483 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:32:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:32:46.551 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:32:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:32:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:32:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:32:46.866 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:32:46.903 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:32:47.527 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:47.568 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:47.587 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:32:48.430 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:32:48.514 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:32:48.657 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:32:48.683 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:32:48.709 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:32:48.743 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:32:48.743 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:32:48.811 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:32:48.811 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:32:48.878 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:32:48.903 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:32:48.908 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:48.908 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:32:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:32:49.172 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:32:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:49.635 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:32:49.636 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:32:49.637 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:32:49.638 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:32:49.639 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:32:49.640 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:32:49.641 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:32:49.643 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:32:49.644 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:32:49.645 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:32:49.646 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:32:49.647 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:32:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:32:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:32:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:32:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:32:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:32:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:32:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:32:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:32:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:32:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:32:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:32:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:32:52.288 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-12T02:32:52.687 DEBUG:teuthology.parallel:result is None 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:32:54.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:32:54.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:32:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:32:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:32:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:32:54.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:32:54.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:32:54.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:32:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:32:54.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:32:54.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:32:54.843 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:32:54.844 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:32:54.845 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:32:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:32:54.847 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:32:54.847 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:32:57.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:32:57.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:32:57.290 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.291 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.292 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.293 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:32:57.294 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:32:57.295 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:32:57.296 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:32:57.297 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:32:57.298 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:32:57.299 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:32:57.300 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:32:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:32:57.302 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:32:57.302 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:32:57.302 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:32:57.302 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:32:57.302 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:32:57.303 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:32:57.303 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:32:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T02:32:57.711 DEBUG:teuthology.parallel:result is None 2024-09-12T02:32:57.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:32:57.858 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:32:57.885 INFO:teuthology.orchestra.run.smithi119.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:32:57.886 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:32:57.886 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:32:57.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:32:58.027 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:32:58.049 INFO:teuthology.orchestra.run.smithi153.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:32:58.049 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:32:58.050 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:32:58.051 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:32:58.052 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:58.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:32:58.084 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:32:58.084 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:32:58.117 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:32:58.117 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:58.117 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:32:58.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:32:58.221 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:32:58.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:32:58.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:32:58.311 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:32:58.311 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:58.311 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:32:58.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:32:58.407 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:32:58.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:32:58.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:32:58.496 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:32:58.496 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:58.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:32:58.523 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:32:58.591 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:32:58.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:32:58.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:32:58.680 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T02:32:58.760 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T02:32:58.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-09-12T02:32:58.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-12T02:32:58.788 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T02:32:58.788 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:32:58.831 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:32:58.855 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T02:32:58.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:32:58.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:32:58.929 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T02:32:58.929 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T02:32:58.930 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T02:32:58.930 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:58.930 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:32:58.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:59.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:59.118 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:32:59.118 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:32:59.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:59.244 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:59.274 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T02:32:59.274 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T02:32:59.275 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-flush}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901628', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrLqqeZcPdqdTqXQ2wCgkiP7Sxj4/atl7s2lXc/75A4nT2s17ndRXEh2Qo+73Oz2ea2NeIFVchNRgWez/WnKQU=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4sQKls8YuxoiK8uRfQYXT+9GXi2ah3eSz6pbS31vmWezVevjbmtz5BwfpdL8QN7XwT2LJonvGVOcj3LO7jpaY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T02:32:59.275 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:32:59.278 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:32:59.325 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:32:59.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:32:59.391 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:32:59.391 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:32:59.412 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:32:59.412 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:32:44.367071974 +0000 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:30:51.793042985 +0000 2024-09-12T02:32:59.468 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:30:51.793042985 +0000 2024-09-12T02:32:59.469 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-12 02:30:51.793042985 +0000 2024-09-12T02:32:59.469 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:32:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:32:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:32:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00026121 s, 2.0 MB/s 2024-09-12T02:32:59.533 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:32:59.589 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-12T02:32:59.644 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:32:59.644 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:32:59.644 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:32:44.367071974 +0000 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:30:52.121034917 +0000 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:30:52.121034917 +0000 2024-09-12T02:32:59.645 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-12 02:30:52.121034917 +0000 2024-09-12T02:32:59.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:32:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:32:59.708 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:32:59.708 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000280499 s, 1.8 MB/s 2024-09-12T02:32:59.709 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:32:59.765 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-12T02:32:59.820 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:32:44.368071949 +0000 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:30:52.443026996 +0000 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:30:52.443026996 +0000 2024-09-12T02:32:59.821 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-12 02:30:52.443026996 +0000 2024-09-12T02:32:59.821 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:32:59.883 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:32:59.884 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:32:59.884 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000190325 s, 2.7 MB/s 2024-09-12T02:32:59.885 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:32:59.941 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-12T02:32:59.996 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:32:44.368071949 +0000 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:30:52.764019100 +0000 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:30:52.764019100 +0000 2024-09-12T02:32:59.997 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-12 02:30:52.764019100 +0000 2024-09-12T02:32:59.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:33:00.060 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:33:00.060 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:33:00.060 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000223655 s, 2.3 MB/s 2024-09-12T02:33:00.061 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:33:00.117 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:00.117 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:00.117 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:33:00.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:33:00.134 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-12T02:33:00.190 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:33:00.190 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:33:00.190 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 02:32:49.656072079 +0000 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 02:30:51.409709453 +0000 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 02:30:51.409709453 +0000 2024-09-12T02:33:00.191 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 02:30:51.409709453 +0000 2024-09-12T02:33:00.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:33:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T02:33:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T02:33:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000203245 s, 2.5 MB/s 2024-09-12T02:33:00.256 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:33:00.313 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 02:32:49.657072061 +0000 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 02:30:51.739703609 +0000 2024-09-12T02:33:00.369 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 02:30:51.739703609 +0000 2024-09-12T02:33:00.370 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 02:30:51.739703609 +0000 2024-09-12T02:33:00.370 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:33:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T02:33:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T02:33:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000186887 s, 2.7 MB/s 2024-09-12T02:33:00.434 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:33:00.490 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-12T02:33:00.545 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:33:00.545 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 02:32:49.657072061 +0000 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 02:30:52.064697853 +0000 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 02:30:52.064697853 +0000 2024-09-12T02:33:00.546 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 02:30:52.064697853 +0000 2024-09-12T02:33:00.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:33:00.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T02:33:00.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T02:33:00.609 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00020475 s, 2.5 MB/s 2024-09-12T02:33:00.610 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:33:00.666 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-12T02:33:00.721 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 02:32:49.657072061 +0000 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 02:30:52.384692186 +0000 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 02:30:52.384692186 +0000 2024-09-12T02:33:00.722 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 02:30:52.384692186 +0000 2024-09-12T02:33:00.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:33:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T02:33:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T02:33:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000194005 s, 2.6 MB/s 2024-09-12T02:33:00.786 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:33:00.842 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:00.842 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:33:00.842 INFO:tasks.ceph:Generating config... 2024-09-12T02:33:00.844 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T02:33:00.844 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T02:33:00.844 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T02:33:00.844 INFO:tasks.ceph:[client] pid file = 2024-09-12T02:33:00.844 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T02:33:00.845 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T02:33:00.845 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T02:33:00.845 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T02:33:00.846 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T02:33:00.846 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T02:33:00.846 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T02:33:00.847 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T02:33:00.848 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T02:33:00.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T02:33:00.907 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T02:33:00.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T02:33:00.955 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:33:00.981 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.119'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-09-12T02:33:00.981 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.119,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T02:33:00.982 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:00.982 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:33:01.037 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.119 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: generated fsid 3a2846d1-7a08-4c1c-a77f-ac792ab98e22 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = quincy 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 0 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:fsid 3a2846d1-7a08-4c1c-a77f-ac792ab98e22 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:last_changed 2024-09-12T02:33:01.126446+0000 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-12T02:33:01.126446+0000 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:min_mon_release 17 (quincy) 2024-09-12T02:33:01.126 INFO:teuthology.orchestra.run.smithi119.stdout:election_strategy: 1 2024-09-12T02:33:01.127 INFO:teuthology.orchestra.run.smithi119.stdout:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T02:33:01.127 INFO:teuthology.orchestra.run.smithi119.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T02:33:01.127 INFO:teuthology.orchestra.run.smithi119.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-12T02:33:01.127 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T02:33:01.128 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:33:01.143 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3a2846d1-7a08-4c1c-a77f-ac792ab98e22... 2024-09-12T02:33:01.144 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:33:01.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:33:01.226 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-09-12T02:33:01.226 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-09-12T02:33:01.226 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:33:01.226 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-09-12T02:33:01.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.227 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-09-12T02:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.119,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on skipped message = False 2024-09-12T02:33:01.229 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 3a2846d1-7a08-4c1c-a77f-ac792ab98e22 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-09-12T02:33:01.230 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-09-12T02:33:01.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:33:01.232 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:33:01.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:33:01.234 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: mon down mkfs grace = 300 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on pool no app = False 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:33:01.235 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-09-12T02:33:01.236 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-12T02:33:01.237 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-12T02:33:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-12T02:33:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.119,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 3a2846d1-7a08-4c1c-a77f-ac792ab98e22 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-12T02:33:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-12T02:33:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.244 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-12T02:33:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:33:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on pool no app = False 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:33:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-12T02:33:01.248 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-09-12T02:33:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-09-12T02:33:01.251 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T02:33:01.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T02:33:01.345 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T02:33:01.345 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:01.346 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T02:33:01.361 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:01.361 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T02:33:01.416 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:33:01.416 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:01.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:33:01.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:33:01.490 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:01.490 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:01.547 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:33:01.547 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:01.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:33:01.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:33:01.583 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:01.583 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:01.639 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T02:33:01.640 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T02:33:01.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:33:01.692 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:33:01.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:33:01.762 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:33:01.765 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T02:33:01.765 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:33:01.816 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:33:01.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T02:33:01.843 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:33:01.934 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:33:01.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T02:33:01.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:33:02.016 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:33:02.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T02:33:02.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:33:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:33:02.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T02:33:02.161 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T02:33:02.162 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:33:02.202 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T02:33:02.214 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T02:33:02.295 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T02:33:02.307 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T02:33:02.348 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T02:33:02.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T02:33:02.442 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T02:33:02.455 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T02:33:02.455 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:33:02.455 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T02:33:02.480 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:02.480 INFO:tasks.ceph:role: osd.0 2024-09-12T02:33:02.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:33:02.480 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:33:02.552 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:02.552 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:02.552 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:02.552 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:02.552 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:02.553 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:02.553 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:02.553 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:02.553 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:02.553 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:03.049 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:33:03.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:33:03.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T02:33:03.163 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T02:33:03.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T02:33:03.260 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:03.260 INFO:tasks.ceph:role: osd.1 2024-09-12T02:33:03.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:33:03.261 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:03.333 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:03.334 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:03.334 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:03.334 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:03.334 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:03.794 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:33:03.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:33:03.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T02:33:03.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T02:33:03.918 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T02:33:03.983 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:03.983 INFO:tasks.ceph:role: osd.2 2024-09-12T02:33:03.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:33:03.983 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:33:04.056 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:04.057 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:04.057 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:04.057 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:04.057 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:04.057 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:04.058 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:04.058 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:04.058 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:04.058 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:04.540 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:33:04.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:33:04.542 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T02:33:04.684 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T02:33:04.714 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T02:33:04.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:04.779 INFO:tasks.ceph:role: osd.3 2024-09-12T02:33:04.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:33:04.780 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:33:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:04.851 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:04.851 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:04.851 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:04.852 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:04.852 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:33:05.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:33:05.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T02:33:05.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T02:33:05.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:05.630+0000 7fcd53c24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T02:33:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:05.631+0000 7fcd53c24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T02:33:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:05.631+0000 7fcd53c24640 -1 bdev(0x563e19f85800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:05.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:05.631+0000 7fcd53c24640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T02:33:09.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T02:33:09.058 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:09.146+0000 7fbdafc16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T02:33:09.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:09.147+0000 7fbdafc16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T02:33:09.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:09.147+0000 7fbdafc16640 -1 bdev(0x56220eea1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:09.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:09.147+0000 7fbdafc16640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T02:33:12.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T02:33:12.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:12.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:12.426+0000 7fee69aa5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T02:33:12.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:12.427+0000 7fee69aa5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T02:33:12.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:12.427+0000 7fee69aa5640 -1 bdev(0x55d5e0b3b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:12.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:12.427+0000 7fee69aa5640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T02:33:15.340 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T02:33:15.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:15.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:15.452+0000 7ff657832640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T02:33:15.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:15.452+0000 7ff657832640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T02:33:15.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:15.452+0000 7ff657832640 -1 bdev(0x55dcf3829800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:15.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:15.452+0000 7ff657832640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T02:33:18.608 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T02:33:18.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T02:33:18.668 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:18.668 INFO:tasks.ceph:role: osd.4 2024-09-12T02:33:18.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:33:18.668 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:33:18.748 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:18.748 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:18.748 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:18.748 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:18.748 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:18.749 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:18.749 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:18.749 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:18.749 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:18.749 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:19.265 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T02:33:19.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T02:33:19.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T02:33:19.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T02:33:19.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T02:33:19.519 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:19.519 INFO:tasks.ceph:role: osd.5 2024-09-12T02:33:19.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:33:19.519 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:33:19.592 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:19.592 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:19.592 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:19.592 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:19.592 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:19.593 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:19.593 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:19.593 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:19.593 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:19.593 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:20.081 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T02:33:20.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T02:33:20.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T02:33:20.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T02:33:20.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T02:33:20.275 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:20.275 INFO:tasks.ceph:role: osd.6 2024-09-12T02:33:20.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:33:20.276 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:20.348 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T02:33:20.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T02:33:20.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T02:33:20.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T02:33:21.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T02:33:21.095 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:33:21.095 INFO:tasks.ceph:role: osd.7 2024-09-12T02:33:21.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:33:21.096 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:33:21.168 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:33:21.169 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:33:21.690 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T02:33:21.693 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T02:33:21.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T02:33:21.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T02:33:21.840 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:21.940+0000 7f85c7b4d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T02:33:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:21.940+0000 7f85c7b4d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T02:33:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:21.940+0000 7f85c7b4d640 -1 bdev(0x563b76adf800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:21.940+0000 7f85c7b4d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T02:33:24.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T02:33:24.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:24.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:24.985+0000 7f1df780f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T02:33:24.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:24.986+0000 7f1df780f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T02:33:24.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:24.986+0000 7f1df780f640 -1 bdev(0x55aa79db9800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:24.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:24.986+0000 7f1df780f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T02:33:28.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T02:33:28.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:28.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:28.258+0000 7f0f64fcc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T02:33:28.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:28.258+0000 7f0f64fcc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T02:33:28.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:28.258+0000 7f0f64fcc640 -1 bdev(0x562148373800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:28.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:28.258+0000 7f0f64fcc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T02:33:29.277 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:29.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:31.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T02:33:31.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:31.278+0000 7f2a92213640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:31.278+0000 7f2a92213640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:31.278+0000 7f2a92213640 -1 bdev(0x562c7d9db800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:31.278+0000 7f2a92213640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T02:33:34.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T02:33:34.225 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T02:33:34.226 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T02:33:34.256 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.256 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T02:33:34.325 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T02:33:34.393 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T02:33:34.460 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T02:33:34.526 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T02:33:34.592 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:34.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T02:33:34.657 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T02:33:34.688 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.688 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T02:33:34.756 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T02:33:34.823 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T02:33:34.894 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T02:33:34.961 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:34.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T02:33:35.027 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:35.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T02:33:35.097 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:35.097 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T02:33:35.114 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:35.114 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T02:33:35.171 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:35.171 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T02:33:35.187 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:35.187 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T02:33:35.243 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T02:33:35.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:33:35.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:33:35.287 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-09-12T02:33:35.287 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDdUuJmjCxJKRAA5BjcgNeqmY3WvOYxLv6iWQ== 2024-09-12T02:33:35.287 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDdUuJmQJauMBAA446bz+yLXbIF56Q7q1xZQg== 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDdUuJmBkS3NxAAoV5JAB0+UwjZMLAK/ZEQQw== 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhUuJmK2qnJRAAaKr+x3dts+TvYU389mmH8Q== 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDlUuJm8vfQCBAAholmz2UE/LZOIy2ISuEMKQ== 2024-09-12T02:33:35.288 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDoUuJm03iAGRAAAnJIcIc4/xNodtHMZIdcGw== 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDrUuJmavgCGxAALJ99wOytjLAfyehVsUuNGg== 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDdUuJmRVh9LRAAHyGFkRBImlL/9YPRrg1sNg== 2024-09-12T02:33:35.289 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmGtIGARAAGIt1SaHZ/uM3FM9lOnkQqA== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmuccSCBAAEwNAFHc4PNw06i4S4+UX6Q== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDxUuJmFx4aOBAAIoG6g2egFn6Zl1NAE5SH7w== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD0UuJmaMzPOhAAuPsD8kT49oNGjzJgMDA+cQ== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD4UuJm2WZ2DxAAk2TS0yXxgl32Zo/TzbwHGA== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD7UuJmZHGkEBAAzgkqZbOlDWy0v+Mt1wkMrg== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmPVgaDBAAWRowUlPoFE58xP7z/Jaokg== 2024-09-12T02:33:35.290 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2024-09-12T02:33:35.291 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmZy2hERAABRBpE6P+++St5dByc0hvDA== 2024-09-12T02:33:35.291 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2024-09-12T02:33:35.291 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmlFfMFBAAu19TdPZwKjilMOb3s064Kw== 2024-09-12T02:33:35.291 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2024-09-12T02:33:35.291 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmCjRoGhAABmpFsmpQCuRJpaF9yu+wkg== 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDdUuJmjCxJKRAA5BjcgNeqmY3WvOYxLv6iWQ== 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDdUuJmQJauMBAA446bz+yLXbIF56Q7q1xZQg== 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDdUuJmBkS3NxAAoV5JAB0+UwjZMLAK/ZEQQw== 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDhUuJmK2qnJRAAaKr+x3dts+TvYU389mmH8Q== 2024-09-12T02:33:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDlUuJm8vfQCBAAholmz2UE/LZOIy2ISuEMKQ== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDoUuJm03iAGRAAAnJIcIc4/xNodtHMZIdcGw== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrUuJmavgCGxAALJ99wOytjLAfyehVsUuNGg== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDdUuJmRVh9LRAAHyGFkRBImlL/9YPRrg1sNg== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmGtIGARAAGIt1SaHZ/uM3FM9lOnkQqA== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmuccSCBAAEwNAFHc4PNw06i4S4+UX6Q== 2024-09-12T02:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDxUuJmFx4aOBAAIoG6g2egFn6Zl1NAE5SH7w== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD0UuJmaMzPOhAAuPsD8kT49oNGjzJgMDA+cQ== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD4UuJm2WZ2DxAAk2TS0yXxgl32Zo/TzbwHGA== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD7UuJmZHGkEBAAzgkqZbOlDWy0v+Mt1wkMrg== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmPVgaDBAAWRowUlPoFE58xP7z/Jaokg== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmZy2hERAABRBpE6P+++St5dByc0hvDA== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmlFfMFBAAu19TdPZwKjilMOb3s064Kw== 2024-09-12T02:33:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-09-12T02:33:35.310 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeUuJmCjRoGhAABmpFsmpQCuRJpaF9yu+wkg== 2024-09-12T02:33:35.311 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:33:35.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:33:35.401 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.566 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.621 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:33:35.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:33:35.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.834 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.836 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:33:35.889 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:35.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:36.049 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:36.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:33:36.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.160 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:33:36.325 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T02:33:36.325 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T02:33:36.352 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:33:36.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T02:33:36.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T02:33:36.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:33:36.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T02:33:36.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T02:33:36.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:33:36.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T02:33:36.804 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:36.806 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:33:36.859 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T02:33:36.860 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:33:36.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:33:36.862 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:33:36.862 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:33:36.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:33:36.902 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:33:36.902 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:33:36.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:33:36.904 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:33:36.904 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T02:33:36.904 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T02:33:36.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T02:33:36.907 INFO:tasks.ceph.mgr.y:Started 2024-09-12T02:33:36.907 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T02:33:36.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T02:33:36.909 INFO:tasks.ceph.mgr.x:Started 2024-09-12T02:33:36.909 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T02:33:36.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T02:33:37.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.007+0000 7f597fd11640 1 Processor -- start 2024-09-12T02:33:37.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.007+0000 7f597fd11640 1 -- start start 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597fd11640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 0x7f5978162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597fd11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597fd11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5978158f50 con 0x7f59780701f0 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597fd11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f59780ae8e0 con 0x7f59780afd60 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597fd11640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5978162fa0 con 0x7f5978158b70 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597e2ae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597e2ae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58168/0 (socket says 172.21.15.119:58168) 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597d2ac640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f59780701f0 0x7f597806e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39464/0 (socket says 172.21.15.119:39464) 2024-09-12T02:33:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.008+0000 7f597e2ae640 1 -- 172.21.15.119:0/2494187257 learned_addr learned my addr 172.21.15.119:0/2494187257 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597e2ae640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 msgr2=0x7f5978070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597e2ae640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 msgr2=0x7f5978070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597e2ae640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597e2ae640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 0x7f5978162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597daad640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 msgr2=0x7f5978162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597daad640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 msgr2=0x7f5978162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 0x7f5978162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.009+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 0x7f5978162a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.170+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486153588 0 0) 0x7f5978158f50 con 0x7f59780701f0 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.170+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5964003520 con 0x7f59780701f0 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 650845986 0 0) 0x7f5964003520 con 0x7f59780701f0 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 msgr2=0x7f5978162a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.153:3300/0 conn(0x7f5978158b70 0x7f5978162a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 msgr2=0x7f5978070680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 --2- 172.21.15.119:0/2494187257 >> v2:172.21.15.119:3300/0 conn(0x7f59780afd60 0x7f5978070680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597815f9f0 con 0x7f59780701f0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f5968001670 con 0x7f59780701f0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 >> v1:172.21.15.119:6789/0 conn(0x7f59780701f0 legacy=0x7f597806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 0x7f5964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5964004800 0x7f5964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640051c0 0x7f596400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5978162fa0 con 0x7f59640039b0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f596400c040 con 0x7f59640051c0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f596400c240 con 0x7f5964004800 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 0x7f5964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597d2ac640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5964004800 0x7f5964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597e2ae640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640051c0 0x7f596400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 -- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5964004800 msgr2=0x7f5964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:37.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5964004800 0x7f5964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 -- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640051c0 msgr2=0x7f596400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640051c0 0x7f596400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597e2ae640 1 -- 172.21.15.119:0/2494187257 reap_dead start 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.171+0000 7f597daad640 1 -- 172.21.15.119:0/2494187257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5964003520 con 0x7f59640039b0 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.172+0000 7f597daad640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 0x7f5964003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f597400b9e0 tx=0x7f5964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424ae713fde75261 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.172+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974030070 con 0x7f59640039b0 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.172+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597402ada0 con 0x7f59640039b0 2024-09-12T02:33:37.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.172+0000 7f597caab640 1 -- 172.21.15.119:0/2494187257 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597400b5e0 con 0x7f59640039b0 2024-09-12T02:33:37.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 -- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 msgr2=0x7f5964003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 0x7f5964003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f597400b9e0 tx=0x7f5964005830 comp rx=0 tx=0).stop 2024-09-12T02:33:37.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 -- 172.21.15.119:0/2494187257 shutdown_connections 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 --2- 172.21.15.119:0/2494187257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59640039b0 0x7f5964003dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 -- 172.21.15.119:0/2494187257 >> 172.21.15.119:0/2494187257 conn(0x7f59780735d0 msgr2=0x7f597806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 -- 172.21.15.119:0/2494187257 shutdown_connections 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.173+0000 7f597fd11640 1 -- 172.21.15.119:0/2494187257 wait complete. 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.174+0000 7f597fd11640 1 Processor -- start 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.174+0000 7f597fd11640 1 -- start start 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640039b0 0x7f59781f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5978161500 0x7f59781f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f597815f430 con 0x7f597815da30 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f597815f150 con 0x7f59640039b0 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597fd11640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f597815f710 con 0x7f5978161500 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58178/0 (socket says 172.21.15.119:58178) 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 -- 172.21.15.119:0/1656043760 learned_addr learned my addr 172.21.15.119:0/1656043760 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597daad640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640039b0 0x7f59781f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597e2ae640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5978161500 0x7f59781f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 -- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5978161500 msgr2=0x7f59781f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5978161500 0x7f59781f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 -- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640039b0 msgr2=0x7f59781f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640039b0 0x7f59781f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 -- 172.21.15.119:0/1656043760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59781f4cc0 con 0x7f597815da30 2024-09-12T02:33:37.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f597d2ac640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5968007340 tx=0x7f5968007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.175+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596800f940 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968018070 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596800fd20 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59781f4fa0 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5978156280 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f596801d460 con 0x7f597815da30 2024-09-12T02:33:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.176+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5968013800 con 0x7f597815da30 2024-09-12T02:33:37.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.177+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597806fe40 con 0x7f597815da30 2024-09-12T02:33:37.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.179+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5968013a50 con 0x7f597815da30 2024-09-12T02:33:37.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.241+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f59781618e0 con 0x7f597815da30 2024-09-12T02:33:37.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.242+0000 7f596e7fc640 1 -- 172.21.15.119:0/1656043760 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5968013c30 con 0x7f597815da30 2024-09-12T02:33:37.243 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 msgr2=0x7f5978160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5968007340 tx=0x7f5968007800 comp rx=0 tx=0).stop 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 shutdown_connections 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5978161500 0x7f59781f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597815da30 0x7f5978160fc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 --2- 172.21.15.119:0/1656043760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59640039b0 0x7f59781f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 >> 172.21.15.119:0/1656043760 conn(0x7f59780735d0 msgr2=0x7f5978162670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 shutdown_connections 2024-09-12T02:33:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:37.243+0000 7f597fd11640 1 -- 172.21.15.119:0/1656043760 wait complete. 2024-09-12T02:33:37.254 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T02:33:37.254 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T02:33:37.255 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:37.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T02:33:37.276 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.276+0000 7efe4f573040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:33:37.277 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.277+0000 7f5be7331040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:33:37.279 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:37.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T02:33:37.317 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.317+0000 7efe4f573040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:33:37.319 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.319+0000 7f5be7331040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:33:37.343 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:37.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T02:33:37.408 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:33:37.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T02:33:37.459 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.459+0000 7efe4f573040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:33:37.464 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.464+0000 7f5be7331040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:33:37.473 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:37.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T02:33:37.499 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:37.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T02:33:37.513 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.512+0000 7efe4f573040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:33:37.516 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.516+0000 7f5be7331040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:33:37.538 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:37.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T02:33:37.605 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:33:37.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T02:33:37.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a91ed7a9-938a-43ca-b627-ac0aa39c7633 0 2024-09-12T02:33:37.672 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.672+0000 7f5be7331040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:33:37.692 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.691+0000 7efe4f573040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:33:37.780 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:37.779+0000 7f5be7331040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.791+0000 7f5335ffd640 1 Processor -- start 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.791+0000 7f5335ffd640 1 -- start start 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5335ffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f533006c320 0x7f533015e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5335ffd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53300b3dc0 con 0x7f5330145cd0 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5335ffd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53300b3ae0 con 0x7f53300b64e0 2024-09-12T02:33:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5335ffd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f53300b3890 con 0x7f533006c320 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f532ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f533006c320 0x7f533015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5327fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f53300b64e0 0x7f533015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53068/0 (socket says 172.21.15.153:53068) 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f5327fff640 1 -- 172.21.15.153:0/2337536659 learned_addr learned my addr 172.21.15.153:0/2337536659 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.792+0000 7f532ffff640 1 -- 172.21.15.153:0/2337536659 >> v1:172.21.15.153:6789/0 conn(0x7f53300b64e0 legacy=0x7f533015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532ffff640 1 -- 172.21.15.153:0/2337536659 >> v1:172.21.15.119:6789/0 conn(0x7f5330145cd0 legacy=0x7f533006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532ffff640 1 -- 172.21.15.153:0/2337536659 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533015d600 con 0x7f533006c320 2024-09-12T02:33:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532ffff640 1 --2- 172.21.15.153:0/2337536659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533006c320 0x7f533015e510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d90 tx=0x7f532802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ffd9f8387f21138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532effd640 1 -- 172.21.15.153:0/2337536659 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328007740 con 0x7f533006c320 2024-09-12T02:33:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532effd640 1 -- 172.21.15.153:0/2337536659 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53280078e0 con 0x7f533006c320 2024-09-12T02:33:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.793+0000 7f532effd640 1 -- 172.21.15.153:0/2337536659 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328007cb0 con 0x7f533006c320 2024-09-12T02:33:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 -- 172.21.15.153:0/2337536659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533006c320 msgr2=0x7f533015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 --2- 172.21.15.153:0/2337536659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533006c320 0x7f533015e510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d90 tx=0x7f532802a660 comp rx=0 tx=0).stop 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 -- 172.21.15.153:0/2337536659 shutdown_connections 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 --2- 172.21.15.153:0/2337536659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533006c320 0x7f533015e510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 -- 172.21.15.153:0/2337536659 >> 172.21.15.153:0/2337536659 conn(0x7f53300734b0 msgr2=0x7f53300b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 -- 172.21.15.153:0/2337536659 shutdown_connections 2024-09-12T02:33:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.794+0000 7f5335ffd640 1 -- 172.21.15.153:0/2337536659 wait complete. 2024-09-12T02:33:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.795+0000 7f5335ffd640 1 Processor -- start 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.795+0000 7f5335ffd640 1 -- start start 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5330145cd0 0x7f533009eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f533009aa30 con 0x7f5330145cd0 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53301460b0 con 0x7f53300b64e0 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5335ffd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f533009abb0 con 0x7f533006c320 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5327fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51460/0 (socket says 172.21.15.153:51460) 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f5327fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47212/0 (socket says 172.21.15.153:47212) 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f532f7fe640 1 -- 172.21.15.153:0/3935831982 learned_addr learned my addr 172.21.15.153:0/3935831982 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.796+0000 7f532ffff640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5330145cd0 0x7f533009eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 -- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 msgr2=0x7f53301f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 -- 172.21.15.153:0/3935831982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5330145cd0 msgr2=0x7f533009eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5330145cd0 0x7f533009eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 -- 172.21.15.153:0/3935831982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300d1b00 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532f7fe640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5327fff640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f531800c470 tx=0x7f5318001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5318017070 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5318005ce0 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300d1de0 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53180072d0 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533015bf60 con 0x7f53300b64e0 2024-09-12T02:33:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f531801a070 con 0x7f53300b64e0 2024-09-12T02:33:37.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.797+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5318012740 con 0x7f53300b64e0 2024-09-12T02:33:37.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.798+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53300ae1b0 con 0x7f53300b64e0 2024-09-12T02:33:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.802+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5318007470 con 0x7f53300b64e0 2024-09-12T02:33:37.811 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:37.810+0000 7efe4f573040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:33:37.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.871+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a91ed7a9-938a-43ca-b627-ac0aa39c7633", "id": 0} v 0) -- 0x7f53300b3670 con 0x7f53300b64e0 2024-09-12T02:33:37.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.879+0000 7f532cff9640 1 -- 172.21.15.153:0/3935831982 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a91ed7a9-938a-43ca-b627-ac0aa39c7633", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f531801c440 con 0x7f53300b64e0 2024-09-12T02:33:37.880 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-09-12T02:33:37.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 msgr2=0x7f533015ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f531800c470 tx=0x7f5318001e70 comp rx=0 tx=0).stop 2024-09-12T02:33:37.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 shutdown_connections 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5330145cd0 0x7f533009eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53300b64e0 0x7f533015ba20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 --2- 172.21.15.153:0/3935831982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533006c320 0x7f53301f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 >> 172.21.15.153:0/3935831982 conn(0x7f53300734b0 msgr2=0x7f533006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 shutdown_connections 2024-09-12T02:33:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.880+0000 7f5335ffd640 1 -- 172.21.15.153:0/3935831982 wait complete. 2024-09-12T02:33:37.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 7d317538-5bab-438c-9e90-e32d83cc5ece 1 2024-09-12T02:33:37.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.990+0000 7f925d759640 1 Processor -- start 2024-09-12T02:33:37.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.990+0000 7f925d759640 1 -- start start 2024-09-12T02:33:37.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f925d759640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f925815b070 0x7f92580b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f925d759640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92580afd10 0x7f92580b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f925d759640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92580cfcb0 con 0x7f92580b03f0 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f925d759640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f92580cfa10 con 0x7f925815b070 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f925d759640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f925806e810 con 0x7f92580afd10 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92580afd10 0x7f92580b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92577fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f92580b03f0 0x7f925815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53080/0 (socket says 172.21.15.153:53080) 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92580afd10 0x7f92580b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47216/0 (socket says 172.21.15.153:47216) 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92577fe640 1 -- 172.21.15.153:0/2932084563 learned_addr learned my addr 172.21.15.153:0/2932084563 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f9256ffd640 1 --2- 172.21.15.153:0/2932084563 >> v2:172.21.15.119:3300/0 conn(0x7f925815b070 0x7f92580b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 -- 172.21.15.153:0/2932084563 >> v2:172.21.15.119:3300/0 conn(0x7f925815b070 msgr2=0x7f92580b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 --2- 172.21.15.153:0/2932084563 >> v2:172.21.15.119:3300/0 conn(0x7f925815b070 0x7f92580b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 -- 172.21.15.153:0/2932084563 >> v1:172.21.15.153:6789/0 conn(0x7f92580b03f0 legacy=0x7f925815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f92567fc640 1 -- 172.21.15.153:0/2932084563 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925806eaf0 con 0x7f92580afd10 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.991+0000 7f9255ffb640 1 -- 172.21.15.153:0/2932084563 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287613945 0 0) 0x7f92580cfcb0 con 0x7f92580b03f0 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.992+0000 7f92567fc640 1 --2- 172.21.15.153:0/2932084563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580b53c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9258073af0 tx=0x7f924002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9416ef4b0b16f020 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.992+0000 7f9255ffb640 1 -- 172.21.15.153:0/2932084563 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240037070 con 0x7f92580afd10 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.992+0000 7f9255ffb640 1 -- 172.21.15.153:0/2932084563 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240032440 con 0x7f92580afd10 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.992+0000 7f9255ffb640 1 -- 172.21.15.153:0/2932084563 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240032810 con 0x7f92580afd10 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 -- 172.21.15.153:0/2932084563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 msgr2=0x7f92580b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 --2- 172.21.15.153:0/2932084563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580b53c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9258073af0 tx=0x7f924002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 -- 172.21.15.153:0/2932084563 shutdown_connections 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 --2- 172.21.15.153:0/2932084563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580b53c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 --2- 172.21.15.153:0/2932084563 >> v2:172.21.15.119:3300/0 conn(0x7f925815b070 0x7f92580b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 -- 172.21.15.153:0/2932084563 >> 172.21.15.153:0/2932084563 conn(0x7f92580735d0 msgr2=0x7f925806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:37.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 -- 172.21.15.153:0/2932084563 shutdown_connections 2024-09-12T02:33:37.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.993+0000 7f925d759640 1 -- 172.21.15.153:0/2932084563 wait complete. 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.994+0000 7f925d759640 1 Processor -- start 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.994+0000 7f925d759640 1 -- start start 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925815b070 0x7f925815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92580b6010 con 0x7f925815b070 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f925815b450 con 0x7f92580afd10 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f925d759640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92580b6190 con 0x7f92580b03f0 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f9256ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51464/0 (socket says 172.21.15.153:51464) 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 -- 172.21.15.153:0/3044031351 learned_addr learned my addr 172.21.15.153:0/3044031351 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f9256ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47230/0 (socket says 172.21.15.153:47230) 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92577fe640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925815b070 0x7f925815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 -- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 msgr2=0x7f92580ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 -- 172.21.15.153:0/3044031351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925815b070 msgr2=0x7f925815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925815b070 0x7f925815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.995+0000 7f92567fc640 1 -- 172.21.15.153:0/3044031351 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925815c260 con 0x7f92580b03f0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f92567fc640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9240009890 tx=0x7f92400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240041070 con 0x7f92580b03f0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924003c890 con 0x7f92580b03f0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92580adfa0 con 0x7f92580b03f0 2024-09-12T02:33:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240037040 con 0x7f92580b03f0 2024-09-12T02:33:38.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92580ae560 con 0x7f92580b03f0 2024-09-12T02:33:38.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9240044070 con 0x7f92580b03f0 2024-09-12T02:33:38.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.996+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9240046de0 con 0x7f92580b03f0 2024-09-12T02:33:38.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.997+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92580b4e80 con 0x7f92580b03f0 2024-09-12T02:33:38.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:37.999+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f924003cc80 con 0x7f92580b03f0 2024-09-12T02:33:38.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.068+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7d317538-5bab-438c-9e90-e32d83cc5ece", "id": 1} v 0) -- 0x7f925815ea00 con 0x7f92580b03f0 2024-09-12T02:33:38.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.073+0000 7f924f7fe640 1 -- 172.21.15.153:0/3044031351 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d317538-5bab-438c-9e90-e32d83cc5ece", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9240046450 con 0x7f92580b03f0 2024-09-12T02:33:38.074 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T02:33:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 msgr2=0x7f925814e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9240009890 tx=0x7f92400046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 shutdown_connections 2024-09-12T02:33:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925815b070 0x7f925815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92580b03f0 0x7f925814e610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.074+0000 7f925d759640 1 --2- 172.21.15.153:0/3044031351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92580afd10 0x7f92580ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.075+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 >> 172.21.15.153:0/3044031351 conn(0x7f92580735d0 msgr2=0x7f925806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.075+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 shutdown_connections 2024-09-12T02:33:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.075+0000 7f925d759640 1 -- 172.21.15.153:0/3044031351 wait complete. 2024-09-12T02:33:38.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 55f338f1-932a-4726-be33-968511cfb4ee 2 2024-09-12T02:33:38.102 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:38.101+0000 7f5be7331040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:33:38.143 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:38.142+0000 7efe4f573040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:33:38.151 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:38.151+0000 7f5be7331040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:33:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.183+0000 7f82184b7640 1 Processor -- start 2024-09-12T02:33:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.183+0000 7f82184b7640 1 -- start start 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.184+0000 7f82184b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.184+0000 7f82184b7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f821015ee10 0x7f821006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.184+0000 7f82184b7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82100b3dc0 con 0x7f82100b64e0 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.184+0000 7f82184b7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f82100b3890 con 0x7f821015ee10 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.184+0000 7f82184b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82100b3ae0 con 0x7f8210145cd0 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8215a52640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f82100b64e0 0x7f821015ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53088/0 (socket says 172.21.15.153:53088) 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51466/0 (socket says 172.21.15.153:51466) 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8215a52640 1 -- 172.21.15.153:0/1055087508 learned_addr learned my addr 172.21.15.153:0/1055087508 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:38.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216a54640 1 --2- 172.21.15.153:0/1055087508 >> v2:172.21.15.119:3300/0 conn(0x7f821015ee10 0x7f821006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 -- 172.21.15.153:0/1055087508 >> v2:172.21.15.119:3300/0 conn(0x7f821015ee10 msgr2=0x7f821006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 --2- 172.21.15.153:0/1055087508 >> v2:172.21.15.119:3300/0 conn(0x7f821015ee10 0x7f821006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 -- 172.21.15.153:0/1055087508 >> v1:172.21.15.153:6789/0 conn(0x7f82100b64e0 legacy=0x7f821015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8216253640 1 -- 172.21.15.153:0/1055087508 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821015d600 con 0x7f8210145cd0 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.185+0000 7f8215251640 1 -- 172.21.15.153:0/1055087508 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150244073 0 0) 0x7f82100b3dc0 con 0x7f82100b64e0 2024-09-12T02:33:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f8216253640 1 --2- 172.21.15.153:0/1055087508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82000097a0 tx=0x7f820002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4cec1dbb0fab650 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f8215251640 1 -- 172.21.15.153:0/1055087508 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200037070 con 0x7f8210145cd0 2024-09-12T02:33:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f8215251640 1 -- 172.21.15.153:0/1055087508 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820002ae50 con 0x7f8210145cd0 2024-09-12T02:33:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f8215251640 1 -- 172.21.15.153:0/1055087508 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200032660 con 0x7f8210145cd0 2024-09-12T02:33:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f82184b7640 1 -- 172.21.15.153:0/1055087508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 msgr2=0x7f821006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.186+0000 7f82184b7640 1 --2- 172.21.15.153:0/1055087508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82000097a0 tx=0x7f820002a100 comp rx=0 tx=0).stop 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 -- 172.21.15.153:0/1055087508 shutdown_connections 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 --2- 172.21.15.153:0/1055087508 >> v2:172.21.15.119:3300/0 conn(0x7f821015ee10 0x7f821006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 --2- 172.21.15.153:0/1055087508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f821006bc10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 -- 172.21.15.153:0/1055087508 >> 172.21.15.153:0/1055087508 conn(0x7f82100734b0 msgr2=0x7f82100b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 -- 172.21.15.153:0/1055087508 shutdown_connections 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.187+0000 7f82184b7640 1 -- 172.21.15.153:0/1055087508 wait complete. 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 Processor -- start 2024-09-12T02:33:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 -- start start 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f82100b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821015ee10 0x7f82100b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f821009aa30 con 0x7f821015ee10 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82101460b0 con 0x7f82100b64e0 2024-09-12T02:33:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.188+0000 7f82184b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f821009abb0 con 0x7f8210145cd0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8215a52640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f82100b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47246/0 (socket says 172.21.15.153:47246) 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 -- 172.21.15.153:0/1440294475 learned_addr learned my addr 172.21.15.153:0/1440294475 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8215a52640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f82100b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51480/0 (socket says 172.21.15.153:51480) 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216a54640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821015ee10 0x7f82100b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 -- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 msgr2=0x7f82100b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f82100b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 -- 172.21.15.153:0/1440294475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821015ee10 msgr2=0x7f82100b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821015ee10 0x7f82100b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 -- 172.21.15.153:0/1440294475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101425c0 con 0x7f82100b64e0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8216253640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f82000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200041070 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820003c460 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200037040 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101428a0 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8210142e60 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8200044070 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.189+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8200046dc0 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.190+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82100b5d60 con 0x7f82100b64e0 2024-09-12T02:33:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.192+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f82100b5d60 con 0x7f82100b64e0 2024-09-12T02:33:38.200 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:38.198+0000 7efe4f573040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:33:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.260+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55f338f1-932a-4726-be33-968511cfb4ee", "id": 2} v 0) -- 0x7f82100ae1b0 con 0x7f82100b64e0 2024-09-12T02:33:38.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.265+0000 7f8206ffd640 1 -- 172.21.15.153:0/1440294475 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55f338f1-932a-4726-be33-968511cfb4ee", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8200046450 con 0x7f82100b64e0 2024-09-12T02:33:38.266 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 msgr2=0x7f821013f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f82000046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 shutdown_connections 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821015ee10 0x7f82100b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8210145cd0 0x7f82100b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 --2- 172.21.15.153:0/1440294475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82100b64e0 0x7f821013f970 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 >> 172.21.15.153:0/1440294475 conn(0x7f82100734b0 msgr2=0x7f821009e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.266+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 shutdown_connections 2024-09-12T02:33:38.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.267+0000 7f82184b7640 1 -- 172.21.15.153:0/1440294475 wait complete. 2024-09-12T02:33:38.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new fcdfc1db-96d2-44b6-8048-f5ba1843df72 3 2024-09-12T02:33:38.302 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:38.302+0000 7f5be7331040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:33:38.355 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:38.354+0000 7efe4f573040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.375+0000 7f2682949640 1 Processor -- start 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.375+0000 7f2682949640 1 -- start start 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f2682949640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f2682949640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f2682949640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c0b6fa0 con 0x7f267c09aa30 2024-09-12T02:33:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f2682949640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f267c0b7280 con 0x7f267c15e520 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f2682949640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f267c0b7560 con 0x7f267c15e900 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f267b7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f267bfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f267b7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51486/0 (socket says 172.21.15.153:51486) 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f267bfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47248/0 (socket says 172.21.15.153:47248) 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.376+0000 7f267b7fe640 1 -- 172.21.15.153:0/1927336456 learned_addr learned my addr 172.21.15.153:0/1927336456 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267b7fe640 1 -- 172.21.15.153:0/1927336456 >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 msgr2=0x7f267c0b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267b7fe640 1 --2- 172.21.15.153:0/1927336456 >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267b7fe640 1 -- 172.21.15.153:0/1927336456 >> v1:172.21.15.119:6789/0 conn(0x7f267c09aa30 legacy=0x7f267c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267b7fe640 1 -- 172.21.15.153:0/1927336456 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c0af3b0 con 0x7f267c15e900 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267bfff640 1 --2- 172.21.15.153:0/1927336456 >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.377+0000 7f267b7fe640 1 --2- 172.21.15.153:0/1927336456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2664009870 tx=0x7f266402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ebc7493d22f25b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f267affd640 1 -- 172.21.15.153:0/1927336456 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664037070 con 0x7f267c15e900 2024-09-12T02:33:38.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f267affd640 1 -- 172.21.15.153:0/1927336456 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664032440 con 0x7f267c15e900 2024-09-12T02:33:38.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f267affd640 1 -- 172.21.15.153:0/1927336456 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664032810 con 0x7f267c15e900 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 -- 172.21.15.153:0/1927336456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 msgr2=0x7f267c06dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 --2- 172.21.15.153:0/1927336456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2664009870 tx=0x7f266402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 -- 172.21.15.153:0/1927336456 shutdown_connections 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 --2- 172.21.15.153:0/1927336456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c06dfd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 --2- 172.21.15.153:0/1927336456 >> v2:172.21.15.153:3300/0 conn(0x7f267c15e520 0x7f267c0b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 -- 172.21.15.153:0/1927336456 >> 172.21.15.153:0/1927336456 conn(0x7f267c0b7970 msgr2=0x7f267c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 -- 172.21.15.153:0/1927336456 shutdown_connections 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.378+0000 7f2682949640 1 -- 172.21.15.153:0/1927336456 wait complete. 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.379+0000 7f2682949640 1 Processor -- start 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 -- start start 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f267c09aa30 0x7f267c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c15e520 0x7f267c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b0a60 con 0x7f267c09aa30 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b08e0 con 0x7f267c15e520 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2682949640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f267c0b0be0 con 0x7f267c15e900 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.380+0000 7f2680ee6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51488/0 (socket says 172.21.15.153:51488) 2024-09-12T02:33:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f267b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c15e520 0x7f267c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 -- 172.21.15.153:0/1175312476 learned_addr learned my addr 172.21.15.153:0/1175312476 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f267bfff640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f267c09aa30 0x7f267c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 -- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c15e520 msgr2=0x7f267c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c15e520 0x7f267c0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 -- 172.21.15.153:0/1175312476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f267c09aa30 msgr2=0x7f267c14df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f267c09aa30 0x7f267c14df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 -- 172.21.15.153:0/1175312476 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c15f710 con 0x7f267c15e900 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2680ee6640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7a0 tx=0x7f267400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674003b70 con 0x7f267c15e900 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674003d30 con 0x7f267c15e900 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267400aa90 con 0x7f267c15e900 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c15f9b0 con 0x7f267c15e900 2024-09-12T02:33:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c160250 con 0x7f267c15e900 2024-09-12T02:33:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f267400ac30 con 0x7f267c15e900 2024-09-12T02:33:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.381+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2674012a40 con 0x7f267c15e900 2024-09-12T02:33:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.382+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c15fb80 con 0x7f267c15e900 2024-09-12T02:33:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.384+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2674012ce0 con 0x7f267c15e900 2024-09-12T02:33:38.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.452+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fcdfc1db-96d2-44b6-8048-f5ba1843df72", "id": 3} v 0) -- 0x7f267c0b6930 con 0x7f267c15e900 2024-09-12T02:33:38.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2678ff9640 1 -- 172.21.15.153:0/1175312476 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fcdfc1db-96d2-44b6-8048-f5ba1843df72", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f26740125b0 con 0x7f267c15e900 2024-09-12T02:33:38.458 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-09-12T02:33:38.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 msgr2=0x7f267c0cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7a0 tx=0x7f267400cc60 comp rx=0 tx=0).stop 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 shutdown_connections 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f267c15e900 0x7f267c0cbaf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c15e520 0x7f267c0cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 --2- 172.21.15.153:0/1175312476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f267c09aa30 0x7f267c14df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.458+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 >> 172.21.15.153:0/1175312476 conn(0x7f267c0b7970 msgr2=0x7f267c0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.459+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 shutdown_connections 2024-09-12T02:33:38.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.459+0000 7f2682949640 1 -- 172.21.15.153:0/1175312476 wait complete. 2024-09-12T02:33:38.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 7d0c56f9-d600-43ad-9557-2ad8b09ebe6b 4 2024-09-12T02:33:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.567+0000 7fe356c1e640 1 Processor -- start 2024-09-12T02:33:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.567+0000 7fe356c1e640 1 -- start start 2024-09-12T02:33:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe356c1e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3500701f0 0x7fe350070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe356c1e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe350158f50 con 0x7fe350158b70 2024-09-12T02:33:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe356c1e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35015f9f0 con 0x7fe3500aed50 2024-09-12T02:33:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe356c1e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe3500ae8e0 con 0x7fe3500701f0 2024-09-12T02:33:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe3551bb640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe3500aed50 0x7fe3500af160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53100/0 (socket says 172.21.15.153:53100) 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe3551bb640 1 -- 172.21.15.153:0/3658822059 learned_addr learned my addr 172.21.15.153:0/3658822059 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe34ffff640 1 --2- 172.21.15.153:0/3658822059 >> v2:172.21.15.119:3300/0 conn(0x7fe3500701f0 0x7fe350070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955201837 0 0) 0x7fe35015f9f0 con 0x7fe3500aed50 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.568+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe340003520 con 0x7fe3500aed50 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.569+0000 7fe34ffff640 1 -- 172.21.15.153:0/3658822059 >> v1:172.21.15.153:6789/0 conn(0x7fe3500aed50 legacy=0x7fe3500af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.569+0000 7fe34ffff640 1 -- 172.21.15.153:0/3658822059 >> v1:172.21.15.119:6789/0 conn(0x7fe350158b70 legacy=0x7fe350162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.569+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331652513 0 0) 0x7fe350158f50 con 0x7fe350158b70 2024-09-12T02:33:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.569+0000 7fe34ffff640 1 -- 172.21.15.153:0/3658822059 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35015ee70 con 0x7fe3500701f0 2024-09-12T02:33:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.570+0000 7fe34ffff640 1 --2- 172.21.15.153:0/3658822059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3500701f0 0x7fe350070680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b239db2f2062d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.570+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c037070 con 0x7fe3500701f0 2024-09-12T02:33:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.570+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c032440 con 0x7fe3500701f0 2024-09-12T02:33:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.570+0000 7fe34f7fe640 1 -- 172.21.15.153:0/3658822059 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c032810 con 0x7fe3500701f0 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 -- 172.21.15.153:0/3658822059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3500701f0 msgr2=0x7fe350070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 --2- 172.21.15.153:0/3658822059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3500701f0 0x7fe350070680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02a230 comp rx=0 tx=0).stop 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 -- 172.21.15.153:0/3658822059 shutdown_connections 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 --2- 172.21.15.153:0/3658822059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3500701f0 0x7fe350070680 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 -- 172.21.15.153:0/3658822059 >> 172.21.15.153:0/3658822059 conn(0x7fe3500735d0 msgr2=0x7fe35006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 -- 172.21.15.153:0/3658822059 shutdown_connections 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.571+0000 7fe356c1e640 1 -- 172.21.15.153:0/3658822059 wait complete. 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.572+0000 7fe356c1e640 1 Processor -- start 2024-09-12T02:33:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.572+0000 7fe356c1e640 1 -- start start 2024-09-12T02:33:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 0x7fe350156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe350158b70 0x7fe3500b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe35015f710 con 0x7fe350158b70 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe35015f430 con 0x7fe3500701f0 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe35006fe40 con 0x7fe3500aed50 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 0x7fe350156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47260/0 (socket says 172.21.15.153:47260) 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 -- 172.21.15.153:0/1053556231 learned_addr learned my addr 172.21.15.153:0/1053556231 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3551bb640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe350158b70 0x7fe3500b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 -- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 msgr2=0x7fe350156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 0x7fe350156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 -- 172.21.15.153:0/1053556231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe350158b70 msgr2=0x7fe3500b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe350158b70 0x7fe3500b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 -- 172.21.15.153:0/1053556231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3501569b0 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe34ffff640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 0x7fe350156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe3549ba640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c4b0 tx=0x7fe34400c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344017070 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344005480 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe350156c90 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344003830 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.573+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe350157250 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.574+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe34401a070 con 0x7fe3500701f0 2024-09-12T02:33:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.574+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe344012910 con 0x7fe3500701f0 2024-09-12T02:33:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.574+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35015ea10 con 0x7fe3500701f0 2024-09-12T02:33:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.576+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe344021070 con 0x7fe3500701f0 2024-09-12T02:33:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.646+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d0c56f9-d600-43ad-9557-2ad8b09ebe6b", "id": 4} v 0) -- 0x7fe350071070 con 0x7fe3500701f0 2024-09-12T02:33:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.651+0000 7fe34d7fa640 1 -- 172.21.15.153:0/1053556231 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d0c56f9-d600-43ad-9557-2ad8b09ebe6b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe344012d20 con 0x7fe3500701f0 2024-09-12T02:33:38.652 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 msgr2=0x7fe350157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c4b0 tx=0x7fe34400c970 comp rx=0 tx=0).stop 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 shutdown_connections 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe350158b70 0x7fe3500b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3500aed50 0x7fe350156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 --2- 172.21.15.153:0/1053556231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3500701f0 0x7fe350157a50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 >> 172.21.15.153:0/1053556231 conn(0x7fe3500735d0 msgr2=0x7fe350160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 shutdown_connections 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.652+0000 7fe356c1e640 1 -- 172.21.15.153:0/1053556231 wait complete. 2024-09-12T02:33:38.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 4b325774-5b63-44d1-8f8d-b163a58a52d5 5 2024-09-12T02:33:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.761+0000 7fa66128d640 1 Processor -- start 2024-09-12T02:33:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.761+0000 7fa66128d640 1 -- start start 2024-09-12T02:33:38.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa66128d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa65c15b070 0x7fa65c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa66128d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa66128d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65c0cfcb0 con 0x7fa65c0afd10 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa66128d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa65c0cfa10 con 0x7fa65c15b070 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa66128d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c06e810 con 0x7fa65c070300 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa65a7fc640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa65c0afd10 0x7fa65c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53114/0 (socket says 172.21.15.153:53114) 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa65b7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa65a7fc640 1 -- 172.21.15.153:0/3668489906 learned_addr learned my addr 172.21.15.153:0/3668489906 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.762+0000 7fa65affd640 1 --2- 172.21.15.153:0/3668489906 >> v2:172.21.15.119:3300/0 conn(0x7fa65c15b070 0x7fa65c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa659ffb640 1 -- 172.21.15.153:0/3668489906 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782897773 0 0) 0x7fa65c0cfcb0 con 0x7fa65c0afd10 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa659ffb640 1 -- 172.21.15.153:0/3668489906 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa644003520 con 0x7fa65c0afd10 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa65b7fe640 1 -- 172.21.15.153:0/3668489906 >> v2:172.21.15.119:3300/0 conn(0x7fa65c15b070 msgr2=0x7fa65c0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa65b7fe640 1 --2- 172.21.15.153:0/3668489906 >> v2:172.21.15.119:3300/0 conn(0x7fa65c15b070 0x7fa65c0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa65b7fe640 1 -- 172.21.15.153:0/3668489906 >> v1:172.21.15.153:6789/0 conn(0x7fa65c0afd10 legacy=0x7fa65c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa65b7fe640 1 -- 172.21.15.153:0/3668489906 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c06eaf0 con 0x7fa65c070300 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.763+0000 7fa65b7fe640 1 --2- 172.21.15.153:0/3668489906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c0b53c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa654009d90 tx=0x7fa65402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=278c601b43c244ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa659ffb640 1 -- 172.21.15.153:0/3668489906 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654007740 con 0x7fa65c070300 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa659ffb640 1 -- 172.21.15.153:0/3668489906 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540078e0 con 0x7fa65c070300 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa659ffb640 1 -- 172.21.15.153:0/3668489906 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654007cb0 con 0x7fa65c070300 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 -- 172.21.15.153:0/3668489906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 msgr2=0x7fa65c0b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 --2- 172.21.15.153:0/3668489906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c0b53c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa654009d90 tx=0x7fa65402a660 comp rx=0 tx=0).stop 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 -- 172.21.15.153:0/3668489906 shutdown_connections 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 --2- 172.21.15.153:0/3668489906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c0b53c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 --2- 172.21.15.153:0/3668489906 >> v2:172.21.15.119:3300/0 conn(0x7fa65c15b070 0x7fa65c0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 -- 172.21.15.153:0/3668489906 >> 172.21.15.153:0/3668489906 conn(0x7fa65c0735d0 msgr2=0x7fa65c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 -- 172.21.15.153:0/3668489906 shutdown_connections 2024-09-12T02:33:38.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.764+0000 7fa66128d640 1 -- 172.21.15.153:0/3668489906 wait complete. 2024-09-12T02:33:38.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 Processor -- start 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 -- start start 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 0x7fa65c143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa65c15b070 0x7fa65c15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c0b6010 con 0x7fa65c15b070 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c15b450 con 0x7fa65c0afd10 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa66128d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c0b6190 con 0x7fa65c070300 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa65affd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa65a7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 0x7fa65c143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa65affd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51508/0 (socket says 172.21.15.153:51508) 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.766+0000 7fa65affd640 1 -- 172.21.15.153:0/746281888 learned_addr learned my addr 172.21.15.153:0/746281888 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65b7fe640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa65c15b070 0x7fa65c15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 -- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 msgr2=0x7fa65c143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 0x7fa65c143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 -- 172.21.15.153:0/746281888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa65c15b070 msgr2=0x7fa65c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa65c15b070 0x7fa65c15cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 -- 172.21.15.153:0/746281888 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c1f5ac0 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65a7fc640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 0x7fa65c143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa65affd640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00e9e0 tx=0x7fa64c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c017070 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c00c9d0 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c1f5da0 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00cdc0 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c15c6c0 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa64c01a070 con 0x7fa65c070300 2024-09-12T02:33:38.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.767+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa64c01cac0 con 0x7fa65c070300 2024-09-12T02:33:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.768+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c15ea00 con 0x7fa65c070300 2024-09-12T02:33:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.770+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa64c01c5a0 con 0x7fa65c070300 2024-09-12T02:33:38.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.837+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b325774-5b63-44d1-8f8d-b163a58a52d5", "id": 5} v 0) -- 0x7fa65c0ce1b0 con 0x7fa65c070300 2024-09-12T02:33:38.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.843+0000 7fa6437fe640 1 -- 172.21.15.153:0/746281888 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b325774-5b63-44d1-8f8d-b163a58a52d5", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa64c01c8b0 con 0x7fa65c070300 2024-09-12T02:33:38.843 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 msgr2=0x7fa65c1f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00e9e0 tx=0x7fa64c00eea0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 shutdown_connections 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa65c15b070 0x7fa65c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c0afd10 0x7fa65c143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 --2- 172.21.15.153:0/746281888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa65c070300 0x7fa65c1f51c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 >> 172.21.15.153:0/746281888 conn(0x7fa65c0735d0 msgr2=0x7fa65c1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 shutdown_connections 2024-09-12T02:33:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.844+0000 7fa66128d640 1 -- 172.21.15.153:0/746281888 wait complete. 2024-09-12T02:33:38.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 92e00df0-52f6-4871-9ecc-275d6acc9487 6 2024-09-12T02:33:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.952+0000 7f05106af640 1 Processor -- start 2024-09-12T02:33:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.952+0000 7f05106af640 1 -- start start 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f05106af640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f050815e520 0x7f05080b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f05106af640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 0x7f050809aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f05106af640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080b6fa0 con 0x7f050815e900 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f05106af640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f05080b7280 con 0x7f050815e520 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f05106af640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05080b7560 con 0x7f050809aa30 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050e44b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f050815e520 0x7f05080b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050dc4a640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f050815e900 0x7f050806dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53122/0 (socket says 172.21.15.153:53122) 2024-09-12T02:33:38.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050ec4c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 0x7f050809aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050dc4a640 1 -- 172.21.15.153:0/1668527866 learned_addr learned my addr 172.21.15.153:0/1668527866 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050e44b640 1 -- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 msgr2=0x7f050809aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050e44b640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 0x7f050809aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.953+0000 7f050e44b640 1 -- 172.21.15.153:0/1668527866 >> v1:172.21.15.153:6789/0 conn(0x7f050815e900 legacy=0x7f050806dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050e44b640 1 -- 172.21.15.153:0/1668527866 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080af3b0 con 0x7f050815e520 2024-09-12T02:33:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050ec4c640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 0x7f050809aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050e44b640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080b6930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05040097a0 tx=0x7f050402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a47d32519cff86c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050d449640 1 -- 172.21.15.153:0/1668527866 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504037070 con 0x7f050815e520 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050d449640 1 -- 172.21.15.153:0/1668527866 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050402ae50 con 0x7f050815e520 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.954+0000 7f050d449640 1 -- 172.21.15.153:0/1668527866 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504032660 con 0x7f050815e520 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 -- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 msgr2=0x7f05080b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080b6930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05040097a0 tx=0x7f050402a100 comp rx=0 tx=0).stop 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 -- 172.21.15.153:0/1668527866 shutdown_connections 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050809aa30 0x7f050809aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 --2- 172.21.15.153:0/1668527866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080b6930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 -- 172.21.15.153:0/1668527866 >> 172.21.15.153:0/1668527866 conn(0x7f05080b7970 msgr2=0x7f05080b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 -- 172.21.15.153:0/1668527866 shutdown_connections 2024-09-12T02:33:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.955+0000 7f05106af640 1 -- 172.21.15.153:0/1668527866 wait complete. 2024-09-12T02:33:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.956+0000 7f05106af640 1 Processor -- start 2024-09-12T02:33:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.956+0000 7f05106af640 1 -- start start 2024-09-12T02:33:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050809aa30 0x7f0508158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 0x7f0508154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f05080afc60 con 0x7f050809aa30 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05080afae0 con 0x7f050815e520 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f05106af640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05080afde0 con 0x7f050815e900 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f050dc4a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f050dc4a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47294/0 (socket says 172.21.15.153:47294) 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f050dc4a640 1 -- 172.21.15.153:0/1111191041 learned_addr learned my addr 172.21.15.153:0/1111191041 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f050ec4c640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 0x7f0508154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.957+0000 7f050e44b640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050809aa30 0x7f0508158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 -- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 msgr2=0x7f05080ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 -- 172.21.15.153:0/1111191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050809aa30 msgr2=0x7f0508158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050809aa30 0x7f0508158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 -- 172.21.15.153:0/1111191041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080cb650 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050dc4a640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f050ec4c640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 0x7f0508154f60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0500009e50 tx=0x7f050000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500018030 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050000cd90 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05080cd250 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500003bb0 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05080cbbd0 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0500005d10 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.958+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f050001daa0 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.959+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05080b6930 con 0x7f050815e900 2024-09-12T02:33:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:38.961+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0500022070 con 0x7f050815e900 2024-09-12T02:33:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.028+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "92e00df0-52f6-4871-9ecc-275d6acc9487", "id": 6} v 0) -- 0x7f050806d760 con 0x7f050815e900 2024-09-12T02:33:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.033+0000 7f04faffd640 1 -- 172.21.15.153:0/1111191041 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92e00df0-52f6-4871-9ecc-275d6acc9487", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0500010040 con 0x7f050815e900 2024-09-12T02:33:39.034 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 msgr2=0x7f0508154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 0x7f0508154f60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0500009e50 tx=0x7f050000c490 comp rx=0 tx=0).stop 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 shutdown_connections 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f050815e900 0x7f0508154f60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050815e520 0x7f05080ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 --2- 172.21.15.153:0/1111191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050809aa30 0x7f0508158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 >> 172.21.15.153:0/1111191041 conn(0x7f05080b7970 msgr2=0x7f050815b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:39.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 shutdown_connections 2024-09-12T02:33:39.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.034+0000 7f05106af640 1 -- 172.21.15.153:0/1111191041 wait complete. 2024-09-12T02:33:39.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new f7e0deaf-2b1b-43ef-b4a0-4af1d568564f 7 2024-09-12T02:33:39.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.144+0000 7efec2b86640 1 Processor -- start 2024-09-12T02:33:39.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.144+0000 7efec2b86640 1 -- start start 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec2b86640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec2b86640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efebc15eff0 con 0x7efebc0b43b0 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec2b86640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efebc15f2d0 con 0x7efebc161ac0 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec2b86640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efebc15f920 con 0x7efebc06c320 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec0922640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efebc161ac0 0x7efebc0b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53136/0 (socket says 172.21.15.153:53136) 2024-09-12T02:33:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec1123640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.145+0000 7efec0922640 1 -- 172.21.15.153:0/3802069901 learned_addr learned my addr 172.21.15.153:0/3802069901 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efebb7fe640 1 -- 172.21.15.153:0/3802069901 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781918735 0 0) 0x7efebc15f2d0 con 0x7efebc161ac0 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efebb7fe640 1 -- 172.21.15.153:0/3802069901 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeac003520 con 0x7efebc161ac0 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efec1123640 1 -- 172.21.15.153:0/3802069901 >> v1:172.21.15.153:6789/0 conn(0x7efebc161ac0 legacy=0x7efebc0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efec1123640 1 -- 172.21.15.153:0/3802069901 >> v1:172.21.15.119:6789/0 conn(0x7efebc0b43b0 legacy=0x7efebc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efec1123640 1 -- 172.21.15.153:0/3802069901 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc15f5b0 con 0x7efebc06c320 2024-09-12T02:33:39.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efec1123640 1 --2- 172.21.15.153:0/3802069901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1693f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009dc0 tx=0x7efeb402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca030695f17bfda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:39.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efebb7fe640 1 -- 172.21.15.153:0/3802069901 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb402ae60 con 0x7efebc06c320 2024-09-12T02:33:39.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efebb7fe640 1 -- 172.21.15.153:0/3802069901 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb4007740 con 0x7efebc06c320 2024-09-12T02:33:39.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.146+0000 7efebb7fe640 1 -- 172.21.15.153:0/3802069901 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4007af0 con 0x7efebc06c320 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 -- 172.21.15.153:0/3802069901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 msgr2=0x7efebc1693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 --2- 172.21.15.153:0/3802069901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1693f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009dc0 tx=0x7efeb402a640 comp rx=0 tx=0).stop 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 -- 172.21.15.153:0/3802069901 shutdown_connections 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 --2- 172.21.15.153:0/3802069901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1693f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 -- 172.21.15.153:0/3802069901 >> 172.21.15.153:0/3802069901 conn(0x7efebc09aa30 msgr2=0x7efebc0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 -- 172.21.15.153:0/3802069901 shutdown_connections 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.147+0000 7efec2b86640 1 -- 172.21.15.153:0/3802069901 wait complete. 2024-09-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.149+0000 7efec2b86640 1 Processor -- start 2024-09-12T02:33:39.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.149+0000 7efec2b86640 1 -- start start 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efebc0b43b0 0x7efebc0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efebc161ac0 0x7efebc09dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efebc161ea0 con 0x7efebc161ac0 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efebc0b2d60 con 0x7efebc0b43b0 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efebc162020 con 0x7efebc06c320 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:51550/0 (socket says 172.21.15.153:51550) 2024-09-12T02:33:39.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 -- 172.21.15.153:0/1091567041 learned_addr learned my addr 172.21.15.153:0/1091567041 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efebbfff640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efebc0b43b0 0x7efebc0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec1123640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efebc161ac0 0x7efebc09dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 -- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efebc0b43b0 msgr2=0x7efebc0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efebc0b43b0 0x7efebc0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 -- 172.21.15.153:0/1091567041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efebc161ac0 msgr2=0x7efebc09dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efebc161ac0 0x7efebc09dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 -- 172.21.15.153:0/1091567041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc0b06f0 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec0922640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c440 tx=0x7efeb000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0017070 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0005ce0 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efebc0b09d0 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00072b0 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.151+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efebc09b8f0 con 0x7efebc06c320 2024-09-12T02:33:39.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.152+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efeb001a070 con 0x7efebc06c320 2024-09-12T02:33:39.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.152+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7efeb0012a60 con 0x7efebc06c320 2024-09-12T02:33:39.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.153+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efebc15f2d0 con 0x7efebc06c320 2024-09-12T02:33:39.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.155+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efebc15f2d0 con 0x7efebc06c320 2024-09-12T02:33:39.229 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.229+0000 7f5be7331040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:33:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.265+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f7e0deaf-2b1b-43ef-b4a0-4af1d568564f", "id": 7} v 0) -- 0x7efebc0d1cb0 con 0x7efebc06c320 2024-09-12T02:33:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.272+0000 7efeb97fa640 1 -- 172.21.15.153:0/1091567041 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7e0deaf-2b1b-43ef-b4a0-4af1d568564f", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7efeb0021020 con 0x7efebc06c320 2024-09-12T02:33:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 msgr2=0x7efebc1f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c440 tx=0x7efeb000c900 comp rx=0 tx=0).stop 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 shutdown_connections 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efebc161ac0 0x7efebc09dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efebc0b43b0 0x7efebc0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 --2- 172.21.15.153:0/1091567041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efebc06c320 0x7efebc1f3ae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 >> 172.21.15.153:0/1091567041 conn(0x7efebc09aa30 msgr2=0x7efebc162220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 shutdown_connections 2024-09-12T02:33:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:33:39.273+0000 7efec2b86640 1 -- 172.21.15.153:0/1091567041 wait complete. 2024-09-12T02:33:39.281 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.281+0000 7f5be7331040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:33:39.285 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T02:33:39.285 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T02:33:39.287 INFO:tasks.ceph.osd.0:Started 2024-09-12T02:33:39.287 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T02:33:39.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T02:33:39.289 INFO:tasks.ceph.osd.1:Started 2024-09-12T02:33:39.289 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T02:33:39.289 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T02:33:39.291 INFO:tasks.ceph.osd.2:Started 2024-09-12T02:33:39.291 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T02:33:39.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T02:33:39.294 INFO:tasks.ceph.osd.3:Started 2024-09-12T02:33:39.294 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T02:33:39.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T02:33:39.296 INFO:tasks.ceph.osd.4:Started 2024-09-12T02:33:39.296 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:33:39.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:33:39.298 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:33:39.298 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T02:33:39.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T02:33:39.300 INFO:tasks.ceph.osd.6:Started 2024-09-12T02:33:39.301 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T02:33:39.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T02:33:39.303 INFO:tasks.ceph.osd.7:Started 2024-09-12T02:33:39.303 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:39.416 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:39.415+0000 7efe4f573040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:33:39.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.434+0000 7ff8544d0640 1 Processor -- start 2024-09-12T02:33:39.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.434+0000 7ff8544d0640 1 -- start start 2024-09-12T02:33:39.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff8544d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff84c09aa30 0x7ff84c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff8544d0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 0x7ff84c09ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff8544d0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c09b350 con 0x7ff84c06cd20 2024-09-12T02:33:39.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff8544d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff84c0d0670 con 0x7ff84c09aa30 2024-09-12T02:33:39.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff8544d0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0b2790 con 0x7ff84c0b3760 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff84c09aa30 0x7ff84c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff852a6d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff84c06cd20 0x7ff84c0d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:56778/0 (socket says 172.21.15.119:56778) 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff852a6d640 1 -- 172.21.15.119:0/774972570 learned_addr learned my addr 172.21.15.119:0/774972570 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff84c09aa30 0x7ff84c0b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39864/0 (socket says 172.21.15.119:39864) 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff851a6b640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 0x7ff84c09ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222489293 0 0) 0x7ff84c09b350 con 0x7ff84c06cd20 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff834003520 con 0x7ff84c06cd20 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 -- 172.21.15.119:0/774972570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 msgr2=0x7ff84c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178747449 0 0) 0x7ff834003520 con 0x7ff84c06cd20 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 0x7ff84c09ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 -- 172.21.15.119:0/774972570 >> v1:172.21.15.119:6789/0 conn(0x7ff84c06cd20 legacy=0x7ff84c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff85226c640 1 -- 172.21.15.119:0/774972570 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c0b2a70 con 0x7ff84c09aa30 2024-09-12T02:33:39.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.435+0000 7ff851a6b640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 0x7ff84c09ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.436+0000 7ff85226c640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c09aa30 0x7ff84c0b3030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097a0 tx=0x7ff84402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb61224edee0206 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.436+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844037070 con 0x7ff84c09aa30 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.436+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84402ab10 con 0x7ff84c09aa30 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.436+0000 7ff85126a640 1 -- 172.21.15.119:0/774972570 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0019f0 con 0x7ff84c09aa30 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 -- 172.21.15.119:0/774972570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c09aa30 msgr2=0x7ff84c0b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c09aa30 0x7ff84c0b3030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097a0 tx=0x7ff84402a080 comp rx=0 tx=0).stop 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 -- 172.21.15.119:0/774972570 shutdown_connections 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c0b3760 0x7ff84c09ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 --2- 172.21.15.119:0/774972570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c09aa30 0x7ff84c0b3030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 -- 172.21.15.119:0/774972570 >> 172.21.15.119:0/774972570 conn(0x7ff84c0d23a0 msgr2=0x7ff84c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:39.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 -- 172.21.15.119:0/774972570 shutdown_connections 2024-09-12T02:33:39.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.437+0000 7ff8544d0640 1 -- 172.21.15.119:0/774972570 wait complete. 2024-09-12T02:33:39.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.438+0000 7ff8544d0640 1 Processor -- start 2024-09-12T02:33:39.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.438+0000 7ff8544d0640 1 -- start start 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff84c06cd20 0x7ff84c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c09aa30 0x7ff84c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c15fca0 con 0x7ff84c0b3760 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0d08a0 con 0x7ff84c06cd20 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff8544d0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c15fe20 con 0x7ff84c09aa30 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39868/0 (socket says 172.21.15.119:39868) 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 -- 172.21.15.119:0/3632592329 learned_addr learned my addr 172.21.15.119:0/3632592329 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:39.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff851a6b640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c09aa30 0x7ff84c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff85226c640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff84c06cd20 0x7ff84c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 -- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c09aa30 msgr2=0x7ff84c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c09aa30 0x7ff84c0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 -- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff84c06cd20 msgr2=0x7ff84c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff84c06cd20 0x7ff84c15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 -- 172.21.15.119:0/3632592329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c0ca370 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.439+0000 7ff852a6d640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00cc30 tx=0x7ff83c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c017070 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c00ce40 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c0cb280 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c012640 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c0cb840 con 0x7ff84c0b3760 2024-09-12T02:33:39.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff83c01a070 con 0x7ff84c0b3760 2024-09-12T02:33:39.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.440+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff83c007740 con 0x7ff84c0b3760 2024-09-12T02:33:39.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.441+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c0d1fe0 con 0x7ff84c0b3760 2024-09-12T02:33:39.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.443+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff83c021020 con 0x7ff84c0b3760 2024-09-12T02:33:39.468 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:39.467+0000 7efe4f573040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:33:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.500+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff84c0b3cb0 con 0x7ff84c0b3760 2024-09-12T02:33:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.500+0000 7ff84affd640 1 -- 172.21.15.119:0/3632592329 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff83c01c4e0 con 0x7ff84c0b3760 2024-09-12T02:33:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:39.501 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":10,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:33:39.266930+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 msgr2=0x7ff84c0713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00cc30 tx=0x7ff83c00a430 comp rx=0 tx=0).stop 2024-09-12T02:33:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 shutdown_connections 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff84c0b3760 0x7ff84c0713f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff84c09aa30 0x7ff84c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 --2- 172.21.15.119:0/3632592329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff84c06cd20 0x7ff84c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 >> 172.21.15.119:0/3632592329 conn(0x7ff84c0d23a0 msgr2=0x7ff84c0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.501+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 shutdown_connections 2024-09-12T02:33:39.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:39.502+0000 7ff8544d0640 1 -- 172.21.15.119:0/3632592329 wait complete. 2024-09-12T02:33:39.512 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T02:33:39.512 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T02:33:39.691 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.690+0000 7f5be7331040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:33:39.775 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.775+0000 7f5be7331040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:33:39.838 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:39.837+0000 7efe4f573040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:33:39.880 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.879+0000 7f5be7331040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:33:39.923 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:39.922+0000 7efe4f573040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:33:39.926 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:39.925+0000 7f5be7331040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:33:40.036 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.030+0000 7efe4f573040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:33:40.040 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.039+0000 7f5be7331040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:33:40.078 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.077+0000 7efe4f573040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:33:40.092 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.091+0000 7f5be7331040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:33:40.136 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.135+0000 7f5be7331040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:33:40.191 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.190+0000 7efe4f573040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:33:40.244 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.243+0000 7efe4f573040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:33:40.250 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.249+0000 7f5be7331040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:33:40.289 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.288+0000 7efe4f573040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:33:40.299 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.298+0000 7f5be7331040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:33:40.322 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:40.352 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.351+0000 7f5be7331040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:33:40.402 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.402+0000 7efe4f573040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:33:40.411 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.411+0000 7fbd14c47640 1 Processor -- start 2024-09-12T02:33:40.411 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.411+0000 7fbd14c47640 1 -- start start 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.411+0000 7fbd14c47640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbd10067aa0 0x7fbd100b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd14c47640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd100aeb60 con 0x7fbd100b5a70 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd14c47640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd100b37d0 con 0x7fbd1015e690 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd14c47640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1006ee30 con 0x7fbd10067aa0 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd0ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbd100b5a70 0x7fbd100afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:56792/0 (socket says 172.21.15.119:56792) 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd0ed9d640 1 -- 172.21.15.119:0/670718797 learned_addr learned my addr 172.21.15.119:0/670718797 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd07fff640 1 --2- 172.21.15.119:0/670718797 >> v2:172.21.15.153:3300/0 conn(0x7fbd10067aa0 0x7fbd100b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932319830 0 0) 0x7fbd100aeb60 con 0x7fbd100b5a70 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcfc003520 con 0x7fbd100b5a70 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd07fff640 1 -- 172.21.15.119:0/670718797 >> v1:172.21.15.153:6789/0 conn(0x7fbd1015e690 legacy=0x7fbd1006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.413 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd07fff640 1 -- 172.21.15.119:0/670718797 >> v1:172.21.15.119:6789/0 conn(0x7fbd100b5a70 legacy=0x7fbd100afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.414 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738935575 0 0) 0x7fbd100b37d0 con 0x7fbd1015e690 2024-09-12T02:33:40.414 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.412+0000 7fbd07fff640 1 -- 172.21.15.119:0/670718797 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd100aee00 con 0x7fbd10067aa0 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.413+0000 7fbd07fff640 1 --2- 172.21.15.119:0/670718797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10067aa0 0x7fbd100b5530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80097d0 tx=0x7fbcf802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7fdb5cb43611d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.413+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8037070 con 0x7fbd10067aa0 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.413+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf8032440 con 0x7fbd10067aa0 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.413+0000 7fbd0dd9b640 1 -- 172.21.15.119:0/670718797 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8032810 con 0x7fbd10067aa0 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 -- 172.21.15.119:0/670718797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10067aa0 msgr2=0x7fbd100b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 --2- 172.21.15.119:0/670718797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10067aa0 0x7fbd100b5530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80097d0 tx=0x7fbcf802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 -- 172.21.15.119:0/670718797 shutdown_connections 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 --2- 172.21.15.119:0/670718797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10067aa0 0x7fbd100b5530 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 -- 172.21.15.119:0/670718797 >> 172.21.15.119:0/670718797 conn(0x7fbd10073580 msgr2=0x7fbd1006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 -- 172.21.15.119:0/670718797 shutdown_connections 2024-09-12T02:33:40.415 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.414+0000 7fbd14c47640 1 -- 172.21.15.119:0/670718797 wait complete. 2024-09-12T02:33:40.416 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.415+0000 7fbd14c47640 1 Processor -- start 2024-09-12T02:33:40.416 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.415+0000 7fbd14c47640 1 -- start start 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd100b5a70 0x7fbd1014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd1015e690 0x7fbd100cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100af3c0 con 0x7fbd10067aa0 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100b5ee0 con 0x7fbd1015e690 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd14c47640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbd100af6a0 con 0x7fbd100b5a70 2024-09-12T02:33:40.418 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39872/0 (socket says 172.21.15.119:39872) 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 -- 172.21.15.119:0/1903917988 learned_addr learned my addr 172.21.15.119:0/1903917988 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0ed9d640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd1015e690 0x7fbd100cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd07fff640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd100b5a70 0x7fbd1014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 -- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd100b5a70 msgr2=0x7fbd1014e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd100b5a70 0x7fbd1014e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 -- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd1015e690 msgr2=0x7fbd100cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd1015e690 0x7fbd100cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.416+0000 7fbd0e59c640 1 -- 172.21.15.119:0/1903917988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1014ea60 con 0x7fbd10067aa0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd0e59c640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c3c0 tx=0x7fbd0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00017070 con 0x7fbd10067aa0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd000035f0 con 0x7fbd10067aa0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd101e65a0 con 0x7fbd10067aa0 2024-09-12T02:33:40.419 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd000039e0 con 0x7fbd10067aa0 2024-09-12T02:33:40.420 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd101e6b60 con 0x7fbd10067aa0 2024-09-12T02:33:40.420 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd0001a070 con 0x7fbd10067aa0 2024-09-12T02:33:40.420 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.417+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbd00012ad0 con 0x7fbd10067aa0 2024-09-12T02:33:40.420 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.418+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd100b4b30 con 0x7fbd10067aa0 2024-09-12T02:33:40.420 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.420+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbd00021020 con 0x7fbd10067aa0 2024-09-12T02:33:40.425 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.422+0000 7f5be7331040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:33:40.452 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.452+0000 7efe4f573040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:33:40.468 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.467+0000 7f5be7331040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:33:40.478 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.477+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd1006cdc0 con 0x7fbd10067aa0 2024-09-12T02:33:40.478 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.478+0000 7fbd06ffd640 1 -- 172.21.15.119:0/1903917988 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbd00003be0 con 0x7fbd10067aa0 2024-09-12T02:33:40.479 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T02:33:40.479 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":10,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:33:39.266930+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 msgr2=0x7fbd101e7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c3c0 tx=0x7fbd0000c880 comp rx=0 tx=0).stop 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 shutdown_connections 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd1015e690 0x7fbd100cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd100b5a70 0x7fbd1014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 --2- 172.21.15.119:0/1903917988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd10067aa0 0x7fbd101e7360 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 >> 172.21.15.119:0/1903917988 conn(0x7fbd10073580 msgr2=0x7fbd100afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 shutdown_connections 2024-09-12T02:33:40.480 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:40.479+0000 7fbd14c47640 1 -- 172.21.15.119:0/1903917988 wait complete. 2024-09-12T02:33:40.489 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:33:40.504 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.504+0000 7efe4f573040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:33:40.514 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:40.514+0000 7f5be7331040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:33:40.534 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T02:33:40.533+0000 7f542a816640 -1 Falling back to public interface 2024-09-12T02:33:40.572 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.571+0000 7efe4f573040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:33:40.608 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T02:33:40.607+0000 7f77548d6640 -1 Falling back to public interface 2024-09-12T02:33:40.618 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.618+0000 7efe4f573040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:33:40.663 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:40.662+0000 7efe4f573040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:33:40.847 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T02:33:40.846+0000 7f3d0b00f640 -1 Falling back to public interface 2024-09-12T02:33:40.860 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T02:33:40.859+0000 7f7b98440640 -1 Falling back to public interface 2024-09-12T02:33:41.004 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T02:33:41.003+0000 7f44547bb640 -1 Falling back to public interface 2024-09-12T02:33:41.007 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T02:33:41.007+0000 7f8de1818640 -1 Falling back to public interface 2024-09-12T02:33:41.022 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T02:33:41.021+0000 7f4ab07dd640 -1 Falling back to public interface 2024-09-12T02:33:41.046 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T02:33:41.045+0000 7f8b5491d640 -1 Falling back to public interface 2024-09-12T02:33:41.167 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:41.167+0000 7f5be7331040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:33:41.325 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-12T02:33:41.324+0000 7efe4f573040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:33:42.189 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:42.188+0000 7f5b87c01640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:33:42.189 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-12T02:33:42.189+0000 7f5b87c01640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T02:33:44.077 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T02:33:44.076+0000 7f542a816640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:33:44.387 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T02:33:44.387+0000 7f3d0b00f640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:33:44.447 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T02:33:44.447+0000 7f77548d6640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:33:44.541 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T02:33:44.541+0000 7f44547bb640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:33:44.788 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T02:33:44.787+0000 7f8b5491d640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:33:44.929 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T02:33:44.929+0000 7f7b98440640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:33:45.059 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T02:33:45.059+0000 7f8de1818640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:33:45.595 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T02:33:45.594+0000 7f4ab07dd640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:33:45.962 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T02:33:45.962+0000 7f54269f5640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:33:45.973 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T02:33:45.973+0000 7f541e001640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:47.297 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:47.422 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.421+0000 7f92c70c9640 1 Processor -- start 2024-09-12T02:33:47.422 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.421+0000 7f92c70c9640 1 -- start start 2024-09-12T02:33:47.423 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.422+0000 7f92c70c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c00d1210 0x7f92c00b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.423 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.422+0000 7f92c70c9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c00d1640 con 0x7f92c00b5430 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.422+0000 7f92c70c9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c00d1910 con 0x7f92c015b480 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.422+0000 7f92c70c9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f92c00d1bf0 con 0x7f92c00d1210 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c00d1210 0x7f92c00b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c00d1210 0x7f92c00b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39976/0 (socket says 172.21.15.119:39976) 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 -- 172.21.15.119:0/1978653465 learned_addr learned my addr 172.21.15.119:0/1978653465 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 -- 172.21.15.119:0/1978653465 >> v1:172.21.15.153:6789/0 conn(0x7f92c015b480 legacy=0x7f92c00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 -- 172.21.15.119:0/1978653465 >> v1:172.21.15.119:6789/0 conn(0x7f92c00b5430 legacy=0x7f92c015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.424 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.423+0000 7f92c5666640 1 -- 172.21.15.119:0/1978653465 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c015bbf0 con 0x7f92c00d1210 2024-09-12T02:33:47.425 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.424+0000 7f92c5666640 1 --2- 172.21.15.119:0/1978653465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c00d1210 0x7f92c00b45c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009ed0 tx=0x7f92b8032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364040778f9083fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.425 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.424+0000 7f92bf7fe640 1 -- 172.21.15.119:0/1978653465 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8033a70 con 0x7f92c00d1210 2024-09-12T02:33:47.425 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.424+0000 7f92bf7fe640 1 -- 172.21.15.119:0/1978653465 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8033c10 con 0x7f92c00d1210 2024-09-12T02:33:47.425 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.424+0000 7f92bf7fe640 1 -- 172.21.15.119:0/1978653465 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b803b3f0 con 0x7f92c00d1210 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.425+0000 7f92c70c9640 1 -- 172.21.15.119:0/1978653465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c00d1210 msgr2=0x7f92c00b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.425+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1978653465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c00d1210 0x7f92c00b45c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009ed0 tx=0x7f92b8032f70 comp rx=0 tx=0).stop 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.425+0000 7f92c70c9640 1 -- 172.21.15.119:0/1978653465 shutdown_connections 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.425+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1978653465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c00d1210 0x7f92c00b45c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.426+0000 7f92c70c9640 1 -- 172.21.15.119:0/1978653465 >> 172.21.15.119:0/1978653465 conn(0x7f92c009aa70 msgr2=0x7f92c00b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:47.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.426+0000 7f92c70c9640 1 -- 172.21.15.119:0/1978653465 shutdown_connections 2024-09-12T02:33:47.427 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.426+0000 7f92c70c9640 1 -- 172.21.15.119:0/1978653465 wait complete. 2024-09-12T02:33:47.428 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.427+0000 7f92c70c9640 1 Processor -- start 2024-09-12T02:33:47.428 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.428+0000 7f92c70c9640 1 -- start start 2024-09-12T02:33:47.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 0x7f92c0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c00d1210 0x7f92c00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92c015cb00 con 0x7f92c015b480 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92c015b860 con 0x7f92c00d1210 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c70c9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92c015cc80 con 0x7f92c00b5430 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c5666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c5666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39988/0 (socket says 172.21.15.119:39988) 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c5666640 1 -- 172.21.15.119:0/1335703396 learned_addr learned my addr 172.21.15.119:0/1335703396 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c4e65640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 0x7f92c0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92bffff640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c00d1210 0x7f92c00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c4e65640 1 -- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c00d1210 msgr2=0x7f92c00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c4e65640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c00d1210 0x7f92c00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.429+0000 7f92c4e65640 1 -- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 msgr2=0x7f92c00cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.430+0000 7f92c4e65640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.430+0000 7f92c4e65640 1 -- 172.21.15.119:0/1335703396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c00af620 con 0x7f92c00b5430 2024-09-12T02:33:47.431 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.430+0000 7f92c5666640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:47.432 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.430+0000 7f92c4e65640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 0x7f92c0156310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c3c0 tx=0x7f92b400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.469 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T02:33:47.469+0000 7f8ddd17a640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:33:47.495 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T02:33:47.495+0000 7f8dd4f9a640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:47.508 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T02:33:47.507+0000 7f445074a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:33:47.525 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T02:33:47.525+0000 7f444856a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:47.601 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.600+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40052d0 con 0x7f92c00b5430 2024-09-12T02:33:47.601 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.600+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b4005490 con 0x7f92c00b5430 2024-09-12T02:33:47.601 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.600+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c00af900 con 0x7f92c00b5430 2024-09-12T02:33:47.601 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.600+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4007260 con 0x7f92c00b5430 2024-09-12T02:33:47.601 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.600+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c00afec0 con 0x7f92c00b5430 2024-09-12T02:33:47.602 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.601+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c00b45c0 con 0x7f92c00b5430 2024-09-12T02:33:47.602 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.602+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f92b4007400 con 0x7f92c00b5430 2024-09-12T02:33:47.603 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.602+0000 7f92bd7fa640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 0x7f92a406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.603 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.602+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f92b40891f0 con 0x7f92c00b5430 2024-09-12T02:33:47.603 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.602+0000 7f92bffff640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 0x7f92a406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.603 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.603+0000 7f92bffff640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 0x7f92a406e2b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92c00cd2c0 tx=0x7f92ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.608 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.607+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92b4058420 con 0x7f92c00b5430 2024-09-12T02:33:47.810 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.809+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92c00b5130 con 0x7f92c00b5430 2024-09-12T02:33:47.810 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.810+0000 7f92bd7fa640 1 -- 172.21.15.119:0/1335703396 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f92b405c720 con 0x7f92c00b5430 2024-09-12T02:33:47.811 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T02:33:47.811 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":14,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:33:47.191560+0000","last_up_change":"2024-09-12T02:33:46.190431+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 msgr2=0x7f92a406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 0x7f92a406e2b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92c00cd2c0 tx=0x7f92ac009040 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 msgr2=0x7f92c0156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 0x7f92c0156310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c3c0 tx=0x7f92b400c880 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 shutdown_connections 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406bdf0 0x7f92a406e2b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c015b480 0x7f92c00cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c00d1210 0x7f92c00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 --2- 172.21.15.119:0/1335703396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c00b5430 0x7f92c0156310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 >> 172.21.15.119:0/1335703396 conn(0x7f92c009aa70 msgr2=0x7f92c006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:47.814 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 shutdown_connections 2024-09-12T02:33:47.815 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:47.813+0000 7f92c70c9640 1 -- 172.21.15.119:0/1335703396 wait complete. 2024-09-12T02:33:47.824 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T02:33:48.146 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T02:33:48.146+0000 7f4aac76c640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:33:48.162 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T02:33:48.162+0000 7f4aa458c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:48.306 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T02:33:48.305+0000 7f3d06992640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:33:48.319 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T02:33:48.319+0000 7f3cfe7b2640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:48.349 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T02:33:48.348+0000 7f7b943cf640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:33:48.354 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T02:33:48.352+0000 7f8b508ac640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:33:48.367 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T02:33:48.367+0000 7f7b8c1ef640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:48.371 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T02:33:48.371+0000 7f8b486cc640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:48.412 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T02:33:48.412+0000 7f7750865640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:33:48.423 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T02:33:48.423+0000 7f7748685640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:54.632 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:54.734 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.733+0000 7f91ab8b7640 1 Processor -- start 2024-09-12T02:33:54.734 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.733+0000 7f91ab8b7640 1 -- start start 2024-09-12T02:33:54.735 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91ab8b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.735 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91ab8b7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a406de10 con 0x7f91a409b890 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91ab8b7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a40d0880 con 0x7f91a415e6d0 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91ab8b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91a40cda70 con 0x7f91a409b180 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91a8e52640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f91a409b890 0x7f91a409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38048/0 (socket says 172.21.15.119:38048) 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91a8e52640 1 -- 172.21.15.119:0/2764208400 learned_addr learned my addr 172.21.15.119:0/2764208400 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.734+0000 7f91a9e54640 1 --2- 172.21.15.119:0/2764208400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024839954 0 0) 0x7f91a406de10 con 0x7f91a409b890 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9190003520 con 0x7f91a409b890 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816783853 0 0) 0x7f91a40d0880 con 0x7f91a415e6d0 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f91a9e54640 1 -- 172.21.15.119:0/2764208400 >> v1:172.21.15.153:6789/0 conn(0x7f91a415e6d0 legacy=0x7f91a406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f91a9e54640 1 -- 172.21.15.119:0/2764208400 >> v1:172.21.15.119:6789/0 conn(0x7f91a409b890 legacy=0x7f91a409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.736 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.735+0000 7f91a9e54640 1 -- 172.21.15.119:0/2764208400 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a40d0b60 con 0x7f91a409b180 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91a9e54640 1 --2- 172.21.15.119:0/2764208400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41693b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f919c009df0 tx=0x7f919c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db92085f328aaef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c007740 con 0x7f91a409b180 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f919c0078e0 con 0x7f91a409b180 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f919bfff640 1 -- 172.21.15.119:0/2764208400 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c007c90 con 0x7f91a409b180 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 -- 172.21.15.119:0/2764208400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 msgr2=0x7f91a41693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/2764208400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41693b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f919c009df0 tx=0x7f919c02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.738 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 -- 172.21.15.119:0/2764208400 shutdown_connections 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/2764208400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41693b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 -- 172.21.15.119:0/2764208400 >> 172.21.15.119:0/2764208400 conn(0x7f91a40d2410 msgr2=0x7f91a40d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.736+0000 7f91ab8b7640 1 -- 172.21.15.119:0/2764208400 shutdown_connections 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.737+0000 7f91ab8b7640 1 -- 172.21.15.119:0/2764208400 wait complete. 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 Processor -- start 2024-09-12T02:33:54.739 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 -- start start 2024-09-12T02:33:54.741 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.741 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.741 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a415e6d0 0x7f91a40cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.741 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f91a40d1400 con 0x7f91a409b890 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91a40d1120 con 0x7f91a415e6d0 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.738+0000 7f91ab8b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91a415eab0 con 0x7f91a409b180 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47596/0 (socket says 172.21.15.119:47596) 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 -- 172.21.15.119:0/3498150844 learned_addr learned my addr 172.21.15.119:0/3498150844 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a9653640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a9e54640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a415e6d0 0x7f91a40cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 -- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 msgr2=0x7f91a41f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 -- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a415e6d0 msgr2=0x7f91a40cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a415e6d0 0x7f91a40cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 -- 172.21.15.119:0/3498150844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a41f4d20 con 0x7f91a409b890 2024-09-12T02:33:54.742 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91a8e52640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f919400c430 tx=0x7f919400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194017070 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9194005ce0 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a40c9a50 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940072f0 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.739+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a40ca010 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.740+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a40d2170 con 0x7f91a409b890 2024-09-12T02:33:54.743 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.741+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f919401a070 con 0x7f91a409b890 2024-09-12T02:33:54.744 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.741+0000 7f9199ffb640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 0x7f918806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.744 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.741+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f919408a060 con 0x7f91a409b890 2024-09-12T02:33:54.744 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.741+0000 7f91a9653640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 0x7f918806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.744 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.742+0000 7f91a9653640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 0x7f918806e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f60 tx=0x7f91a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:54.747 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.746+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91a41f4d20 con 0x7f91a409b890 2024-09-12T02:33:54.915 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.915+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91a40b7ec0 con 0x7f91a409b890 2024-09-12T02:33:54.916 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.916+0000 7f9199ffb640 1 -- 172.21.15.119:0/3498150844 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12956 (secure 0 0 0) 0x7f9194058ce0 con 0x7f91a409b890 2024-09-12T02:33:54.916 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T02:33:54.916 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":18,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:33:51.367414+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 msgr2=0x7f918806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 0x7f918806e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f60 tx=0x7f91a0009040 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 msgr2=0x7f91a40b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f919400c430 tx=0x7f919400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 shutdown_connections 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f918806be30 0x7f918806e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a415e6d0 0x7f91a40cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91a409b890 0x7f91a40b6a70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 --2- 172.21.15.119:0/3498150844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91a409b180 0x7f91a41f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 >> 172.21.15.119:0/3498150844 conn(0x7f91a40d2410 msgr2=0x7f91a409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:54.919 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 shutdown_connections 2024-09-12T02:33:54.920 INFO:teuthology.misc.health.smithi119.stderr:2024-09-12T02:33:54.918+0000 7f91ab8b7640 1 -- 172.21.15.119:0/3498150844 wait complete. 2024-09-12T02:33:54.928 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T02:33:54.928 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T02:33:54.928 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:33:54.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:33:54.931 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:33:54.931 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:33:54.932 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:33:54.934 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:33:54.934 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:33:54.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:33:54.937 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:33:54.937 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:33:54.937 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:33:54.940 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:33:54.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T02:33:54.940 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:55.007 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-09-12T02:33:55.008 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2024-09-12T02:33:55.008 INFO:tasks.ceph.mds.c.smithi119.stderr:2024-09-12T02:33:55.007+0000 7ff3e6d37640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T02:33:55.024 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-12T02:33:55.024 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-12T02:33:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 Processor -- start 2024-09-12T02:33:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 -- start start 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd41c15e5b0 0x7fd41c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd41c0ae140 0x7fd41c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c0aeb10 con 0x7fd41c15e990 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0b2c30 con 0x7fd41c15e5b0 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.042+0000 7fd4212c9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0b17f0 con 0x7fd41c0ae140 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd41c15e5b0 0x7fd41c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41a7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd41c15e990 0x7fd41c0b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38062/0 (socket says 172.21.15.119:38062) 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41a7fc640 1 -- 172.21.15.119:0/248548171 learned_addr learned my addr 172.21.15.119:0/248548171 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41b7fe640 1 --2- 172.21.15.119:0/248548171 >> v2:172.21.15.153:3300/0 conn(0x7fd41c0ae140 0x7fd41c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41affd640 1 -- 172.21.15.119:0/248548171 >> v2:172.21.15.153:3300/0 conn(0x7fd41c0ae140 msgr2=0x7fd41c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41affd640 1 --2- 172.21.15.119:0/248548171 >> v2:172.21.15.153:3300/0 conn(0x7fd41c0ae140 0x7fd41c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41affd640 1 -- 172.21.15.119:0/248548171 >> v1:172.21.15.119:6789/0 conn(0x7fd41c15e990 legacy=0x7fd41c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd419ffb640 1 -- 172.21.15.119:0/248548171 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890548301 0 0) 0x7fd41c0aeb10 con 0x7fd41c15e990 2024-09-12T02:33:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.043+0000 7fd41affd640 1 -- 172.21.15.119:0/248548171 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0b6520 con 0x7fd41c15e5b0 2024-09-12T02:33:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd41affd640 1 --2- 172.21.15.119:0/248548171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c15e5b0 0x7fd41c0b5f40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b4c20 tx=0x7fd40c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be63053d3450ccc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd419ffb640 1 -- 172.21.15.119:0/248548171 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c037070 con 0x7fd41c15e5b0 2024-09-12T02:33:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd419ffb640 1 -- 172.21.15.119:0/248548171 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c032440 con 0x7fd41c15e5b0 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd419ffb640 1 -- 172.21.15.119:0/248548171 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c032810 con 0x7fd41c15e5b0 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 -- 172.21.15.119:0/248548171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c15e5b0 msgr2=0x7fd41c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 --2- 172.21.15.119:0/248548171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c15e5b0 0x7fd41c0b5f40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b4c20 tx=0x7fd40c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 -- 172.21.15.119:0/248548171 shutdown_connections 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 --2- 172.21.15.119:0/248548171 >> v2:172.21.15.153:3300/0 conn(0x7fd41c0ae140 0x7fd41c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 --2- 172.21.15.119:0/248548171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c15e5b0 0x7fd41c0b5f40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 -- 172.21.15.119:0/248548171 >> 172.21.15.119:0/248548171 conn(0x7fd41c073490 msgr2=0x7fd41c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 -- 172.21.15.119:0/248548171 shutdown_connections 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.044+0000 7fd4212c9640 1 -- 172.21.15.119:0/248548171 wait complete. 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.046+0000 7fd4212c9640 1 Processor -- start 2024-09-12T02:33:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.046+0000 7fd4212c9640 1 -- start start 2024-09-12T02:33:55.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 0x7fd41c148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd41c15e990 0x7fd41c0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b2000 con 0x7fd41c0ae140 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b1d20 con 0x7fd41c15e5b0 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47632/0 (socket says 172.21.15.119:47632) 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 -- 172.21.15.119:0/1160079173 learned_addr learned my addr 172.21.15.119:0/1160079173 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0b0490 con 0x7fd41c15e990 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41a7fc640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 0x7fd41c148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41b7fe640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd41c15e990 0x7fd41c0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 -- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd41c15e990 msgr2=0x7fd41c0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd41c15e990 0x7fd41c0cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 -- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 msgr2=0x7fd41c148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 0x7fd41c148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41affd640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0ccba0 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.047+0000 7fd41a7fc640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 0x7fd41c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd41affd640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009890 tx=0x7fd40c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c037040 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c042070 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c030960 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c15eec0 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.048+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c15f480 con 0x7fd41c0ae140 2024-09-12T02:33:55.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.049+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c0b5f40 con 0x7fd41c0ae140 2024-09-12T02:33:55.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.050+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd40c030b00 con 0x7fd41c0ae140 2024-09-12T02:33:55.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.050+0000 7fd4037fe640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 0x7fd40806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.050+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd40c0ab2c0 con 0x7fd41c0ae140 2024-09-12T02:33:55.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.050+0000 7fd41a7fc640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 0x7fd40806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.050+0000 7fd41a7fc640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 0x7fd40806e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41c1f7840 tx=0x7fd410007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.054+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd40c079970 con 0x7fd41c0ae140 2024-09-12T02:33:55.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.257+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd41c06c100 con 0x7fd41c0ae140 2024-09-12T02:33:55.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.257+0000 7fd4037fe640 1 -- 172.21.15.119:0/1160079173 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fd40c07dc70 con 0x7fd41c0ae140 2024-09-12T02:33:55.258 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:55.258 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"btime":"2024-09-12T02:33:55:011337+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:33:55.259 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 2 2024-09-12T02:33:55.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 msgr2=0x7fd40806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 0x7fd40806e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41c1f7840 tx=0x7fd410007d50 comp rx=0 tx=0).stop 2024-09-12T02:33:55.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 msgr2=0x7fd41c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009890 tx=0x7fd40c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 shutdown_connections 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd40806be30 0x7fd40806e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd41c15e990 0x7fd41c0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd41c15e5b0 0x7fd41c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 --2- 172.21.15.119:0/1160079173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c0ae140 0x7fd41c0d0490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 >> 172.21.15.119:0/1160079173 conn(0x7fd41c073490 msgr2=0x7fd41c06f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 shutdown_connections 2024-09-12T02:33:55.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:55.260+0000 7fd4212c9640 1 -- 172.21.15.119:0/1160079173 wait complete. 2024-09-12T02:33:57.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.382+0000 7fbe0d178640 1 Processor -- start 2024-09-12T02:33:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.382+0000 7fbe0d178640 1 -- start start 2024-09-12T02:33:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0d178640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe08162060 0x7fbe080b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0d178640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0d178640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0806d9f0 con 0x7fbe08161c80 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0d178640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0806dcd0 con 0x7fbe08162060 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0d178640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0806dfb0 con 0x7fbe080b64b0 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbdfe59c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe08162060 0x7fbe080b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0759e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbdfe59c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe08162060 0x7fbe080b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:37866/0 (socket says 172.21.15.119:37866) 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbe0759e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:43610/0 (socket says 172.21.15.119:43610) 2024-09-12T02:33:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.383+0000 7fbdfe59c640 1 -- 172.21.15.119:0/1670083453 learned_addr learned my addr 172.21.15.119:0/1670083453 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbdfe59c640 1 -- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 msgr2=0x7fbe080b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbdfe59c640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbdfe59c640 1 -- 172.21.15.119:0/1670083453 >> v1:172.21.15.153:6789/0 conn(0x7fbe08161c80 legacy=0x7fbe0806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbdfe59c640 1 -- 172.21.15.119:0/1670083453 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080d01f0 con 0x7fbe08162060 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbe0759e640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbdfe59c640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe08162060 0x7fbe080b5f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009870 tx=0x7fbdf002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2abced9688316024 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.384+0000 7fbe0659c640 1 -- 172.21.15.119:0/1670083453 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0037070 con 0x7fbe08162060 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0659c640 1 -- 172.21.15.119:0/1670083453 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0032440 con 0x7fbe08162060 2024-09-12T02:33:57.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0659c640 1 -- 172.21.15.119:0/1670083453 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0032810 con 0x7fbe08162060 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 -- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe08162060 msgr2=0x7fbe080b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe08162060 0x7fbe080b5f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009870 tx=0x7fbdf002a270 comp rx=0 tx=0).stop 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 -- 172.21.15.119:0/1670083453 shutdown_connections 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe080b64b0 0x7fbe080b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 --2- 172.21.15.119:0/1670083453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe08162060 0x7fbe080b5f70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 -- 172.21.15.119:0/1670083453 >> 172.21.15.119:0/1670083453 conn(0x7fbe080d44f0 msgr2=0x7fbe080d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 -- 172.21.15.119:0/1670083453 shutdown_connections 2024-09-12T02:33:57.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.385+0000 7fbe0d178640 1 -- 172.21.15.119:0/1670083453 wait complete. 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.386+0000 7fbe0d178640 1 Processor -- start 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 -- start start 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe080b64b0 0x7fbe080b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe08161c80 0x7fbe080b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080cf360 con 0x7fbe08162060 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080cf1e0 con 0x7fbe080b64b0 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.387+0000 7fbe0d178640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe080cf4e0 con 0x7fbe08161c80 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47638/0 (socket says 172.21.15.119:47638) 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 -- 172.21.15.119:0/3857333188 learned_addr learned my addr 172.21.15.119:0/3857333188 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbdfe59c640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe08161c80 0x7fbe080b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe06d9d640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe080b64b0 0x7fbe080b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 -- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe08161c80 msgr2=0x7fbe080b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe08161c80 0x7fbe080b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 -- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe080b64b0 msgr2=0x7fbe080b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe080b64b0 0x7fbe080b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 -- 172.21.15.119:0/3857333188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080b7590 con 0x7fbe08162060 2024-09-12T02:33:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0759e640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000efc0 tx=0x7fbe00009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00018030 con 0x7fbe08162060 2024-09-12T02:33:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0000cde0 con 0x7fbe08162060 2024-09-12T02:33:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00003bb0 con 0x7fbe08162060 2024-09-12T02:33:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe080b7870 con 0x7fbe08162060 2024-09-12T02:33:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.388+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe080b7e30 con 0x7fbe08162060 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.389+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe080b5f70 con 0x7fbe08162060 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.390+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe00005d10 con 0x7fbe08162060 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.390+0000 7fbdfffff640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.390+0000 7fbe06d9d640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.390+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fbe0008b4b0 con 0x7fbe08162060 2024-09-12T02:33:57.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.391+0000 7fbe06d9d640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 0x7fbde806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8001780 tx=0x7fbdf8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.395+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe00022070 con 0x7fbe08162060 2024-09-12T02:33:57.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.598+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe080ba470 con 0x7fbe08162060 2024-09-12T02:33:57.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.598+0000 7fbdfffff640 1 -- 172.21.15.119:0/3857333188 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7fbe00010040 con 0x7fbe08162060 2024-09-12T02:33:57.599 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:57.599 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"btime":"2024-09-12T02:33:56:012939+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:33:57.600 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 3 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 msgr2=0x7fbde806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 0x7fbde806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8001780 tx=0x7fbdf8009040 comp rx=0 tx=0).stop 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 msgr2=0x7fbe080b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000efc0 tx=0x7fbe00009f90 comp rx=0 tx=0).stop 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 shutdown_connections 2024-09-12T02:33:57.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe08162060 0x7fbe080b98b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe08161c80 0x7fbe080b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 --2- 172.21.15.119:0/3857333188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe080b64b0 0x7fbe080b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 >> 172.21.15.119:0/3857333188 conn(0x7fbe080d44f0 msgr2=0x7fbe0806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 shutdown_connections 2024-09-12T02:33:57.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.600+0000 7fbe0d178640 1 -- 172.21.15.119:0/3857333188 wait complete. 2024-09-12T02:33:57.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:33:57.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.708+0000 7f41cd7b7640 1 Processor -- start 2024-09-12T02:33:57.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.708+0000 7f41cd7b7640 1 -- start start 2024-09-12T02:33:57.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41cd7b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41cd7b7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41c80b6680 0x7f41c80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41cd7b7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c806e870 con 0x7f41c8162060 2024-09-12T02:33:57.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41cd7b7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f41c806d9f0 con 0x7f41c80b6680 2024-09-12T02:33:57.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41cd7b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41c806dcd0 con 0x7f41c8161c80 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41c77fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41c80b6680 0x7f41c80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41c6ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41c77fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41c80b6680 0x7f41c80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:37886/0 (socket says 172.21.15.119:37886) 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.709+0000 7f41c77fe640 1 -- 172.21.15.119:0/3420956621 learned_addr learned my addr 172.21.15.119:0/3420956621 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c77fe640 1 -- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 msgr2=0x7f41c806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c77fe640 1 --2- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c77fe640 1 -- 172.21.15.119:0/3420956621 >> v1:172.21.15.153:6789/0 conn(0x7f41c8162060 legacy=0x7f41c80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c77fe640 1 -- 172.21.15.119:0/3420956621 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c806dfb0 con 0x7f41c80b6680 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c77fe640 1 --2- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c80cf1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009e50 tx=0x7f41c002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adddfcfddaa3daf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c67fc640 1 -- 172.21.15.119:0/3420956621 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036070 con 0x7f41c80b6680 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c67fc640 1 -- 172.21.15.119:0/3420956621 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c0031600 con 0x7f41c80b6680 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.710+0000 7f41c67fc640 1 -- 172.21.15.119:0/3420956621 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c00319d0 con 0x7f41c80b6680 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 -- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 msgr2=0x7f41c80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c80cf1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009e50 tx=0x7f41c002a710 comp rx=0 tx=0).stop 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 -- 172.21.15.119:0/3420956621 shutdown_connections 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c80cf1e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/3420956621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 -- 172.21.15.119:0/3420956621 >> 172.21.15.119:0/3420956621 conn(0x7f41c80d44f0 msgr2=0x7f41c80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 -- 172.21.15.119:0/3420956621 shutdown_connections 2024-09-12T02:33:57.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.711+0000 7f41cd7b7640 1 -- 172.21.15.119:0/3420956621 wait complete. 2024-09-12T02:33:57.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.712+0000 7f41cd7b7640 1 Processor -- start 2024-09-12T02:33:57.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.712+0000 7f41cd7b7640 1 -- start start 2024-09-12T02:33:57.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c8155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c81f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41c80b6b30 con 0x7f41c8162060 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41c80d2aa0 con 0x7f41c80b6680 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41cd7b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41c80b6cb0 con 0x7f41c8161c80 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47648/0 (socket says 172.21.15.119:47648) 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41c77fe640 1 -- 172.21.15.119:0/1104404956 learned_addr learned my addr 172.21.15.119:0/1104404956 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41c6ffd640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c8155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.713+0000 7f41be7fc640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c81f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 -- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 msgr2=0x7f41c81f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c81f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 -- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 msgr2=0x7f41c8155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c8155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 -- 172.21.15.119:0/1104404956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c8155f50 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41c77fe640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41c0034040 tx=0x7f41c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036050 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c0042070 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c81f4ff0 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0009510 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.714+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c80b23f0 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.715+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c806e330 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.715+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41c0007c70 con 0x7f41c8162060 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.716+0000 7f41bffff640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 0x7f41a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.716+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f41c00ab760 con 0x7f41c8162060 2024-09-12T02:33:57.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.716+0000 7f41c6ffd640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 0x7f41a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.716+0000 7f41c6ffd640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 0x7f41a806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009aa0 tx=0x7f41b8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.720+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41c8155f50 con 0x7f41c8162060 2024-09-12T02:33:57.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.886+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f41c8162dd0 con 0x7f41c8162060 2024-09-12T02:33:57.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.887+0000 7f41bffff640 1 -- 172.21.15.119:0/1104404956 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f41c0079e10 con 0x7f41c8162060 2024-09-12T02:33:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:33:57.888 INFO:teuthology.orchestra.run.smithi119.stdout:] 2024-09-12T02:33:57.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 msgr2=0x7f41a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 0x7f41a806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009aa0 tx=0x7f41b8009190 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 msgr2=0x7f41c81f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41c0034040 tx=0x7f41c0004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 shutdown_connections 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41a806be30 0x7f41a806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c8162060 0x7f41c81f4a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41c8161c80 0x7f41c81f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 --2- 172.21.15.119:0/1104404956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c80b6680 0x7f41c8155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 >> 172.21.15.119:0/1104404956 conn(0x7f41c80d44f0 msgr2=0x7f41c80cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 shutdown_connections 2024-09-12T02:33:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:57.889+0000 7f41cd7b7640 1 -- 172.21.15.119:0/1104404956 wait complete. 2024-09-12T02:33:57.900 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:33:57.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:33:58.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.001+0000 7fc6c3bb7640 1 Processor -- start 2024-09-12T02:33:58.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.001+0000 7fc6c3bb7640 1 -- start start 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c3bb7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 0x7fc6bc072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c3bb7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 0x7fc6bc072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c3bb7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc0cec90 con 0x7fc6bc15b7f0 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c3bb7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc0cef70 con 0x7fc6bc0ce6e0 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c3bb7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0cf250 con 0x7fc6bc15b410 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1152640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc6bc15b7f0 0x7fc6bc0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38064/0 (socket says 172.21.15.119:38064) 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1152640 1 -- 172.21.15.119:0/2823025122 learned_addr learned my addr 172.21.15.119:0/2823025122 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:58.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1953640 1 --2- 172.21.15.119:0/2823025122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 0x7fc6bc072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c2154640 1 --2- 172.21.15.119:0/2823025122 >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 0x7fc6bc072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c0951640 1 -- 172.21.15.119:0/2823025122 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187349352 0 0) 0x7fc6bc0cec90 con 0x7fc6bc15b7f0 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c0951640 1 -- 172.21.15.119:0/2823025122 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a8003520 con 0x7fc6bc15b7f0 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1953640 1 -- 172.21.15.119:0/2823025122 >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 msgr2=0x7fc6bc072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1953640 1 --2- 172.21.15.119:0/2823025122 >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 0x7fc6bc072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1953640 1 -- 172.21.15.119:0/2823025122 >> v1:172.21.15.119:6789/0 conn(0x7fc6bc15b7f0 legacy=0x7fc6bc0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c1953640 1 -- 172.21.15.119:0/2823025122 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0cf530 con 0x7fc6bc15b410 2024-09-12T02:33:58.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.002+0000 7fc6c2154640 1 --2- 172.21.15.119:0/2823025122 >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 0x7fc6bc072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.003+0000 7fc6c1953640 1 --2- 172.21.15.119:0/2823025122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 0x7fc6bc072050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80097a0 tx=0x7fc6b802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5f8f8e4e161d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.003+0000 7fc6c0951640 1 -- 172.21.15.119:0/2823025122 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8037070 con 0x7fc6bc15b410 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.003+0000 7fc6c0951640 1 -- 172.21.15.119:0/2823025122 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b802ae50 con 0x7fc6bc15b410 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.003+0000 7fc6c0951640 1 -- 172.21.15.119:0/2823025122 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8032640 con 0x7fc6bc15b410 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/2823025122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 msgr2=0x7fc6bc072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/2823025122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 0x7fc6bc072050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80097a0 tx=0x7fc6b802a100 comp rx=0 tx=0).stop 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/2823025122 shutdown_connections 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/2823025122 >> v2:172.21.15.153:3300/0 conn(0x7fc6bc0ce6e0 0x7fc6bc072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/2823025122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b410 0x7fc6bc072050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/2823025122 >> 172.21.15.119:0/2823025122 conn(0x7fc6bc06bdf0 msgr2=0x7fc6bc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/2823025122 shutdown_connections 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.004+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/2823025122 wait complete. 2024-09-12T02:33:58.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.005+0000 7fc6c3bb7640 1 Processor -- start 2024-09-12T02:33:58.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.005+0000 7fc6c3bb7640 1 -- start start 2024-09-12T02:33:58.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6bc0ce6e0 0x7fc6bc150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b7f0 0x7fc6bc1f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b33e0 con 0x7fc6bc15b410 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b3260 con 0x7fc6bc0ce6e0 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b3560 con 0x7fc6bc15b7f0 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47658/0 (socket says 172.21.15.119:47658) 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 -- 172.21.15.119:0/1302807513 learned_addr learned my addr 172.21.15.119:0/1302807513 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1953640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6bc0ce6e0 0x7fc6bc150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c2154640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b7f0 0x7fc6bc1f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 -- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b7f0 msgr2=0x7fc6bc1f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b7f0 0x7fc6bc1f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 -- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6bc0ce6e0 msgr2=0x7fc6bc150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6bc0ce6e0 0x7fc6bc150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 -- 172.21.15.119:0/1302807513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc1f88f0 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c1152640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c410 tx=0x7fc6ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac017070 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac005ce0 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0072f0 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.006+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc1f4e00 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.007+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc1f7bb0 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.008+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc0cdfd0 con 0x7fc6bc15b410 2024-09-12T02:33:58.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.008+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6ac01a070 con 0x7fc6bc15b410 2024-09-12T02:33:58.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.008+0000 7fc6b27fc640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 0x7fc6a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.009+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc6ac089ec0 con 0x7fc6bc15b410 2024-09-12T02:33:58.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.009+0000 7fc6c1953640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 0x7fc6a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.009+0000 7fc6c1953640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 0x7fc6a006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.013+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6ac058d10 con 0x7fc6bc15b410 2024-09-12T02:33:58.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:58.180+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc6bc0d0690 con 0x7fc6bc15b410 2024-09-12T02:33:59.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.028+0000 7fc6b27fc640 1 -- 172.21.15.119:0/1302807513 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fc6ac058610 con 0x7fc6bc15b410 2024-09-12T02:33:59.029 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2024-09-12T02:33:59.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.031+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 msgr2=0x7fc6a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.031+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 0x7fc6a006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b802e000 comp rx=0 tx=0).stop 2024-09-12T02:33:59.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.031+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 msgr2=0x7fc6bc1f83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.031+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c410 tx=0x7fc6ac00c8d0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 shutdown_connections 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc6a006be30 0x7fc6a006e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6bc15b7f0 0x7fc6bc1f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6bc15b410 0x7fc6bc1f83b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 --2- 172.21.15.119:0/1302807513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6bc0ce6e0 0x7fc6bc150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.032+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 >> 172.21.15.119:0/1302807513 conn(0x7fc6bc06bdf0 msgr2=0x7fc6bc06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:59.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.033+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 shutdown_connections 2024-09-12T02:33:59.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.033+0000 7fc6c3bb7640 1 -- 172.21.15.119:0/1302807513 wait complete. 2024-09-12T02:33:59.049 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.159+0000 7ff192111640 1 Processor -- start 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.159+0000 7ff192111640 1 -- start start 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff192111640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff18c15e7f0 0x7ff18c0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff192111640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff18c06cdc0 con 0x7ff18c071180 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff192111640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff18c06d0a0 con 0x7ff18c0af210 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff192111640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff18c06d380 con 0x7ff18c15e7f0 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff18c071180 0x7ff18c06de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33700/0 (socket says 172.21.15.119:33700) 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18bfff640 1 -- 172.21.15.119:0/3885108309 learned_addr learned my addr 172.21.15.119:0/3885108309 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18b7fe640 1 --2- 172.21.15.119:0/3885108309 >> v2:172.21.15.153:3300/0 conn(0x7ff18c15e7f0 0x7ff18c0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900204548 0 0) 0x7ff18c06cdc0 con 0x7ff18c071180 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff174003520 con 0x7ff18c071180 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252815364 0 0) 0x7ff174003520 con 0x7ff18c071180 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18b7fe640 1 -- 172.21.15.119:0/3885108309 >> v1:172.21.15.153:6789/0 conn(0x7ff18c0af210 legacy=0x7ff18c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18b7fe640 1 -- 172.21.15.119:0/3885108309 >> v1:172.21.15.119:6789/0 conn(0x7ff18c071180 legacy=0x7ff18c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.160+0000 7ff18b7fe640 1 -- 172.21.15.119:0/3885108309 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c06d660 con 0x7ff18c15e7f0 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.161+0000 7ff18b7fe640 1 --2- 172.21.15.119:0/3885108309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c15e7f0 0x7ff18c0b6d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e70c12adf8fac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.161+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c037070 con 0x7ff18c15e7f0 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.161+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c02ac50 con 0x7ff18c15e7f0 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.161+0000 7ff18a7fc640 1 -- 172.21.15.119:0/3885108309 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1840019f0 con 0x7ff18c15e7f0 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 -- 172.21.15.119:0/3885108309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c15e7f0 msgr2=0x7ff18c0b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 --2- 172.21.15.119:0/3885108309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c15e7f0 0x7ff18c0b6d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 -- 172.21.15.119:0/3885108309 shutdown_connections 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 --2- 172.21.15.119:0/3885108309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c15e7f0 0x7ff18c0b6d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 -- 172.21.15.119:0/3885108309 >> 172.21.15.119:0/3885108309 conn(0x7ff18c0b3f30 msgr2=0x7ff18c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 -- 172.21.15.119:0/3885108309 shutdown_connections 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.162+0000 7ff192111640 1 -- 172.21.15.119:0/3885108309 wait complete. 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.163+0000 7ff192111640 1 Processor -- start 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.163+0000 7ff192111640 1 -- start start 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 0x7ff18c1f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff18c15e7f0 0x7ff18c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c0b73d0 con 0x7ff18c071180 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c0b7250 con 0x7ff18c0af210 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff192111640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff18c0b7550 con 0x7ff18c15e7f0 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42710/0 (socket says 172.21.15.119:42710) 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 -- 172.21.15.119:0/2829803084 learned_addr learned my addr 172.21.15.119:0/2829803084 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18affd640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 0x7ff18c1f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18bfff640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff18c15e7f0 0x7ff18c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 -- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff18c15e7f0 msgr2=0x7ff18c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff18c15e7f0 0x7ff18c153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 -- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 msgr2=0x7ff18c1f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 0x7ff18c1f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 -- 172.21.15.119:0/2829803084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c1f1b50 con 0x7ff18c071180 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18affd640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 0x7ff18c1f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff18b7fe640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.164+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c041070 con 0x7ff18c071180 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.165+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c03c460 con 0x7ff18c071180 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.165+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c1f50c0 con 0x7ff18c071180 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.165+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c037040 con 0x7ff18c071180 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.165+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c15efc0 con 0x7ff18c071180 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.166+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c0b6d10 con 0x7ff18c071180 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.166+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff17c044070 con 0x7ff18c071180 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.167+0000 7ff173fff640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 0x7ff17806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.167+0000 7ff18affd640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 0x7ff17806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.167+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7ff17c0ab250 con 0x7ff18c071180 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.167+0000 7ff18affd640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 0x7ff17806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff180007fd0 tx=0x7ff180009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.171+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff18c1f50c0 con 0x7ff18c071180 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:33:59.338+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ff18c0b0f50 con 0x7ff18c071180 2024-09-12T02:33:59.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:59.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.035+0000 7ff173fff640 1 -- 172.21.15.119:0/2829803084 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7ff17c079e70 con 0x7ff18c071180 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 msgr2=0x7ff17806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 0x7ff17806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff180007fd0 tx=0x7ff180009040 comp rx=0 tx=0).stop 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 msgr2=0x7ff18c1f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 shutdown_connections 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff17806be30 0x7ff17806e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff18c15e7f0 0x7ff18c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18c0af210 0x7ff18c1f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 --2- 172.21.15.119:0/2829803084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c071180 0x7ff18c1f1610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 >> 172.21.15.119:0/2829803084 conn(0x7ff18c0b3f30 msgr2=0x7ff18c0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 shutdown_connections 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.038+0000 7ff192111640 1 -- 172.21.15.119:0/2829803084 wait complete. 2024-09-12T02:34:00.061 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.165+0000 7fc851d98640 1 Processor -- start 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.165+0000 7fc851d98640 1 -- start start 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc851d98640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc84c09aa30 0x7fc84c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc851d98640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84c0d0bd0 con 0x7fc84c09ae10 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc851d98640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84c0d0eb0 con 0x7fc84c06cf20 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc851d98640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc84c0d17e0 con 0x7fc84c09aa30 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc84c09ae10 0x7fc84c15f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33712/0 (socket says 172.21.15.119:33712) 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84affd640 1 -- 172.21.15.119:0/2046167316 learned_addr learned my addr 172.21.15.119:0/2046167316 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/2046167316 >> v2:172.21.15.153:3300/0 conn(0x7fc84c09aa30 0x7fc84c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84a7fc640 1 -- 172.21.15.119:0/2046167316 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834862764 0 0) 0x7fc84c0d0bd0 con 0x7fc84c09ae10 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84a7fc640 1 -- 172.21.15.119:0/2046167316 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc834003520 con 0x7fc84c09ae10 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84b7fe640 1 -- 172.21.15.119:0/2046167316 >> v1:172.21.15.153:6789/0 conn(0x7fc84c06cf20 legacy=0x7fc84c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84b7fe640 1 -- 172.21.15.119:0/2046167316 >> v1:172.21.15.119:6789/0 conn(0x7fc84c09ae10 legacy=0x7fc84c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.166+0000 7fc84b7fe640 1 -- 172.21.15.119:0/2046167316 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c0d1190 con 0x7fc84c09aa30 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.167+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/2046167316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c0d0510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0097a0 tx=0x7fc83c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795faa6989dd03bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.167+0000 7fc84a7fc640 1 -- 172.21.15.119:0/2046167316 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c037070 con 0x7fc84c09aa30 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.167+0000 7fc84a7fc640 1 -- 172.21.15.119:0/2046167316 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c032640 con 0x7fc84c09aa30 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.167+0000 7fc84a7fc640 1 -- 172.21.15.119:0/2046167316 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c032a10 con 0x7fc84c09aa30 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 -- 172.21.15.119:0/2046167316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 msgr2=0x7fc84c0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 --2- 172.21.15.119:0/2046167316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c0d0510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0097a0 tx=0x7fc83c02a2c0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 -- 172.21.15.119:0/2046167316 shutdown_connections 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 --2- 172.21.15.119:0/2046167316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c0d0510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 -- 172.21.15.119:0/2046167316 >> 172.21.15.119:0/2046167316 conn(0x7fc84c0d2380 msgr2=0x7fc84c0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 -- 172.21.15.119:0/2046167316 shutdown_connections 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.168+0000 7fc851d98640 1 -- 172.21.15.119:0/2046167316 wait complete. 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.169+0000 7fc851d98640 1 Processor -- start 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.169+0000 7fc851d98640 1 -- start start 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 0x7fc84c09fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c09cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c15fa20 con 0x7fc84c09ae10 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c09b280 con 0x7fc84c09aa30 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc851d98640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c15fba0 con 0x7fc84c06cf20 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42724/0 (socket says 172.21.15.119:42724) 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 -- 172.21.15.119:0/3301744169 learned_addr learned my addr 172.21.15.119:0/3301744169 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 0x7fc84c09fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84affd640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c09cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 -- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 msgr2=0x7fc84c09fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 0x7fc84c09fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 -- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 msgr2=0x7fc84c09cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c09cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 -- 172.21.15.119:0/3301744169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c09d4d0 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 0x7fc84c09fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84affd640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c09cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc84bfff640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc84400c6b0 tx=0x7fc84400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.170+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844003b70 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.171+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844003d30 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.171+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c09d770 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.171+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844005310 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.171+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c15ccd0 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.172+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c0d0510 con 0x7fc84c09ae10 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.172+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8440054b0 con 0x7fc84c09ae10 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.173+0000 7fc833fff640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 0x7fc83806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.173+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 0x7fc83806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.173+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fc84408acb0 con 0x7fc84c09ae10 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.173+0000 7fc84b7fe640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 0x7fc83806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc83c034000 tx=0x7fc83c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.177+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8440596c0 con 0x7fc84c09ae10 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:00.379+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc84c0b70f0 con 0x7fc84c09ae10 2024-09-12T02:34:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.037+0000 7fc833fff640 1 -- 172.21.15.119:0/3301744169 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc844058fc0 con 0x7fc84c09ae10 2024-09-12T02:34:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:34:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 msgr2=0x7fc83806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 0x7fc83806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc83c034000 tx=0x7fc83c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 msgr2=0x7fc84c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc84400c6b0 tx=0x7fc84400cb70 comp rx=0 tx=0).stop 2024-09-12T02:34:01.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 shutdown_connections 2024-09-12T02:34:01.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc83806be30 0x7fc83806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc84c09ae10 0x7fc84c15a3a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc84c09aa30 0x7fc84c09cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 --2- 172.21.15.119:0/3301744169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc84c06cf20 0x7fc84c09fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.041+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 >> 172.21.15.119:0/3301744169 conn(0x7fc84c0d2380 msgr2=0x7fc84c0cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.042+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 shutdown_connections 2024-09-12T02:34:01.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.046+0000 7fc851d98640 1 -- 172.21.15.119:0/3301744169 wait complete. 2024-09-12T02:34:01.069 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T02:34:01.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T02:34:01.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.176+0000 7f182338d640 1 Processor -- start 2024-09-12T02:34:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.176+0000 7f182338d640 1 -- start start 2024-09-12T02:34:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f182338d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f181c0b63a0 0x7f181c0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f182338d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c0b1d00 con 0x7f181c0b1870 2024-09-12T02:34:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f182338d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c0b5840 con 0x7f181c15c160 2024-09-12T02:34:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f182338d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f181c0b1670 con 0x7f181c0b63a0 2024-09-12T02:34:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f1820928640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f181c0b63a0 0x7f181c0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f1820928640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f181c0b63a0 0x7f181c0b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42734/0 (socket says 172.21.15.119:42734) 2024-09-12T02:34:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f1820928640 1 -- 172.21.15.119:0/1932725918 learned_addr learned my addr 172.21.15.119:0/1932725918 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.177+0000 7f182192a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f181c0b1870 0x7f181c0afba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33726/0 (socket says 172.21.15.119:33726) 2024-09-12T02:34:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f1820928640 1 -- 172.21.15.119:0/1932725918 >> v1:172.21.15.153:6789/0 conn(0x7f181c15c160 legacy=0x7f181c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f1820928640 1 -- 172.21.15.119:0/1932725918 >> v1:172.21.15.119:6789/0 conn(0x7f181c0b1870 legacy=0x7f181c0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f181bfff640 1 -- 172.21.15.119:0/1932725918 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949563847 0 0) 0x7f181c0b1d00 con 0x7f181c0b1870 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f1820928640 1 -- 172.21.15.119:0/1932725918 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c09b690 con 0x7f181c0b63a0 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f1820928640 1 --2- 172.21.15.119:0/1932725918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c0b63a0 0x7f181c0b5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1810009870 tx=0x7f181002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c8cebe85d8eb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.178+0000 7f181bfff640 1 -- 172.21.15.119:0/1932725918 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810037070 con 0x7f181c0b63a0 2024-09-12T02:34:01.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f181bfff640 1 -- 172.21.15.119:0/1932725918 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1810032440 con 0x7f181c0b63a0 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f181bfff640 1 -- 172.21.15.119:0/1932725918 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810032810 con 0x7f181c0b63a0 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 -- 172.21.15.119:0/1932725918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c0b63a0 msgr2=0x7f181c0b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 --2- 172.21.15.119:0/1932725918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c0b63a0 0x7f181c0b5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1810009870 tx=0x7f181002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 -- 172.21.15.119:0/1932725918 shutdown_connections 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 --2- 172.21.15.119:0/1932725918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c0b63a0 0x7f181c0b5260 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 -- 172.21.15.119:0/1932725918 >> 172.21.15.119:0/1932725918 conn(0x7f181c0b3f60 msgr2=0x7f181c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 -- 172.21.15.119:0/1932725918 shutdown_connections 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.179+0000 7f182338d640 1 -- 172.21.15.119:0/1932725918 wait complete. 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.180+0000 7f182338d640 1 Processor -- start 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.180+0000 7f182338d640 1 -- start start 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181c0b1870 0x7f181c1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f181c0b63a0 0x7f181c1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f181c09bc50 con 0x7f181c15c160 2024-09-12T02:34:01.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f181c09b440 con 0x7f181c0b63a0 2024-09-12T02:34:01.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182338d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f181c15c540 con 0x7f181c0b1870 2024-09-12T02:34:01.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42744/0 (socket says 172.21.15.119:42744) 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 -- 172.21.15.119:0/3165113294 learned_addr learned my addr 172.21.15.119:0/3165113294 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f1820928640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f181c0b63a0 0x7f181c1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f1821129640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181c0b1870 0x7f181c1f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 -- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181c0b1870 msgr2=0x7f181c1f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181c0b1870 0x7f181c1f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 -- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f181c0b63a0 msgr2=0x7f181c1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f181c0b63a0 0x7f181c1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.181+0000 7f182192a640 1 -- 172.21.15.119:0/3165113294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c1525a0 con 0x7f181c15c160 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f182192a640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f181400c480 tx=0x7f181400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814018070 con 0x7f181c15c160 2024-09-12T02:34:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814007500 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814004a20 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c14f770 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.182+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c14fd30 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.183+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c0b5260 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.183+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f181401b070 con 0x7f181c15c160 2024-09-12T02:34:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.184+0000 7f1819ffb640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 0x7f180806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.184+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f181408a090 con 0x7f181c15c160 2024-09-12T02:34:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.184+0000 7f1821129640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 0x7f180806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.184+0000 7f1821129640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 0x7f180806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b450 tx=0x7f180c00d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.188+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1814058480 con 0x7f181c15c160 2024-09-12T02:34:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:01.361+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f181c06c070 con 0x7f181c15c160 2024-09-12T02:34:02.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.038+0000 7f1819ffb640 1 -- 172.21.15.119:0/3165113294 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f181405c780 con 0x7f181c15c160 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 msgr2=0x7f180806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 0x7f180806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b450 tx=0x7f180c00d040 comp rx=0 tx=0).stop 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 msgr2=0x7f181c148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f181400c480 tx=0x7f181400c940 comp rx=0 tx=0).stop 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 shutdown_connections 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f180806be30 0x7f180806e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181c15c160 0x7f181c148540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f181c0b63a0 0x7f181c1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 --2- 172.21.15.119:0/3165113294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181c0b1870 0x7f181c1f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 >> 172.21.15.119:0/3165113294 conn(0x7f181c0b3f60 msgr2=0x7f181c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:02.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 shutdown_connections 2024-09-12T02:34:02.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.041+0000 7f182338d640 1 -- 172.21.15.119:0/3165113294 wait complete. 2024-09-12T02:34:02.053 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:34:02.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.159+0000 7fcaaf882640 1 Processor -- start 2024-09-12T02:34:02.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.159+0000 7fcaaf882640 1 -- start start 2024-09-12T02:34:02.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaaf882640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 0x7fcaa80d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaaf882640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcaa806cf20 0x7fcaa806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaaf882640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa80d0bd0 con 0x7fcaa809ae10 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaaf882640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa80d17e0 con 0x7fcaa806cf20 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaaf882640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa80d0eb0 con 0x7fcaa809aa30 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaace1d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcaa809ae10 0x7fcaa815f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33740/0 (socket says 172.21.15.119:33740) 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaace1d640 1 -- 172.21.15.119:0/303033282 learned_addr learned my addr 172.21.15.119:0/303033282 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaad61e640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 0x7fcaa80d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaade1f640 1 --2- 172.21.15.119:0/303033282 >> v2:172.21.15.153:3300/0 conn(0x7fcaa806cf20 0x7fcaa806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fca9ffff640 1 -- 172.21.15.119:0/303033282 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002602910 0 0) 0x7fcaa80d0bd0 con 0x7fcaa809ae10 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fca9ffff640 1 -- 172.21.15.119:0/303033282 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca94003520 con 0x7fcaa809ae10 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaade1f640 1 -- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 msgr2=0x7fcaa80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaade1f640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 0x7fcaa80d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaade1f640 1 -- 172.21.15.119:0/303033282 >> v1:172.21.15.119:6789/0 conn(0x7fcaa809ae10 legacy=0x7fcaa815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaade1f640 1 -- 172.21.15.119:0/303033282 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa80d1190 con 0x7fcaa806cf20 2024-09-12T02:34:02.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.160+0000 7fcaad61e640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 0x7fcaa80d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:02.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.161+0000 7fcaade1f640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa806cf20 0x7fcaa806d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a317753d25c8cf1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:02.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.161+0000 7fca9ffff640 1 -- 172.21.15.119:0/303033282 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0007740 con 0x7fcaa806cf20 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.161+0000 7fca9ffff640 1 -- 172.21.15.119:0/303033282 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa00078e0 con 0x7fcaa806cf20 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.161+0000 7fca9ffff640 1 -- 172.21.15.119:0/303033282 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0007c90 con 0x7fcaa806cf20 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 -- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa806cf20 msgr2=0x7fcaa806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa806cf20 0x7fcaa806d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 -- 172.21.15.119:0/303033282 shutdown_connections 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa806cf20 0x7fcaa806d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 --2- 172.21.15.119:0/303033282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809aa30 0x7fcaa80d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 -- 172.21.15.119:0/303033282 >> 172.21.15.119:0/303033282 conn(0x7fcaa80d2380 msgr2=0x7fcaa80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 -- 172.21.15.119:0/303033282 shutdown_connections 2024-09-12T02:34:02.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.162+0000 7fcaaf882640 1 -- 172.21.15.119:0/303033282 wait complete. 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.163+0000 7fcaaf882640 1 Processor -- start 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.163+0000 7fcaaf882640 1 -- start start 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 0x7fcaa8153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809ae10 0x7fcaa8162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa809b250 con 0x7fcaa806cf20 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa815fa20 con 0x7fcaa809aa30 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaaf882640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa80c78b0 con 0x7fcaa809ae10 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42760/0 (socket says 172.21.15.119:42760) 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 -- 172.21.15.119:0/890373356 learned_addr learned my addr 172.21.15.119:0/890373356 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaace1d640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 0x7fcaa8153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaade1f640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809ae10 0x7fcaa8162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 -- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809ae10 msgr2=0x7fcaa8162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809ae10 0x7fcaa8162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 -- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 msgr2=0x7fcaa8153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 0x7fcaa8153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 -- 172.21.15.119:0/890373356 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa80c7560 con 0x7fcaa806cf20 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaace1d640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 0x7fcaa8153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.164+0000 7fcaad61e640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400e990 tx=0x7fcaa400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.165+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4017070 con 0x7fcaa806cf20 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.165+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa400c9e0 con 0x7fcaa806cf20 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.165+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa80c6ae0 con 0x7fcaa806cf20 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.165+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400cdb0 con 0x7fcaa806cf20 2024-09-12T02:34:02.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.165+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa8162e50 con 0x7fcaa806cf20 2024-09-12T02:34:02.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.166+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa80d0bd0 con 0x7fcaa806cf20 2024-09-12T02:34:02.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.166+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaa401a070 con 0x7fcaa806cf20 2024-09-12T02:34:02.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.167+0000 7fca9dffb640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:02.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.167+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7fcaa408ae90 con 0x7fcaa806cf20 2024-09-12T02:34:02.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.167+0000 7fcaace1d640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:02.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.167+0000 7fcaace1d640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 0x7fca8c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80b8290 tx=0x7fca98009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:02.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.171+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaa4059690 con 0x7fcaa806cf20 2024-09-12T02:34:02.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:02.338+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcaa80d3290 con 0x7fcaa806cf20 2024-09-12T02:34:04.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.057+0000 7fca9dffb640 1 -- 172.21.15.119:0/890373356 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7fcaa4058f90 con 0x7fcaa806cf20 2024-09-12T02:34:04.058 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' created 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 msgr2=0x7fca8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 0x7fca8c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80b8290 tx=0x7fca98009040 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 msgr2=0x7fcaa815ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400e990 tx=0x7fcaa400ee50 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 shutdown_connections 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcaa809ae10 0x7fcaa8162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaa809aa30 0x7fcaa8153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 --2- 172.21.15.119:0/890373356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaa806cf20 0x7fcaa815ff10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 >> 172.21.15.119:0/890373356 conn(0x7fcaa80d2380 msgr2=0x7fcaa806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:04.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 shutdown_connections 2024-09-12T02:34:04.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.062+0000 7fcaaf882640 1 -- 172.21.15.119:0/890373356 wait complete. 2024-09-12T02:34:04.081 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T02:34:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.183+0000 7f796f1e4640 1 Processor -- start 2024-09-12T02:34:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f796f1e4640 1 -- start start 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f796f1e4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79680cda30 0x7f796809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f796f1e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79680ce010 con 0x7f79680b3220 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f796f1e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79680cfff0 con 0x7f7968161e60 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f796f1e4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f79680ce2f0 con 0x7f79680cda30 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f795ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f79680b3220 0x7f796806cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33744/0 (socket says 172.21.15.119:33744) 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.184+0000 7f795ffff640 1 -- 172.21.15.119:0/1537129138 learned_addr learned my addr 172.21.15.119:0/1537129138 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341477004 0 0) 0x7f79680ce010 con 0x7f79680b3220 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7950003520 con 0x7f79680b3220 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f796d781640 1 --2- 172.21.15.119:0/1537129138 >> v2:172.21.15.153:3300/0 conn(0x7f79680cda30 0x7f796809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 884892866 0 0) 0x7f7950003520 con 0x7f79680b3220 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 >> v2:172.21.15.153:3300/0 conn(0x7f79680cda30 msgr2=0x7f796809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:04.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 --2- 172.21.15.119:0/1537129138 >> v2:172.21.15.153:3300/0 conn(0x7f79680cda30 0x7f796809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 >> v1:172.21.15.153:6789/0 conn(0x7f7968161e60 legacy=0x7f79680d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79680d02d0 con 0x7f79680b3220 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f7958001670 con 0x7f79680b3220 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 >> v1:172.21.15.119:6789/0 conn(0x7f79680b3220 legacy=0x7f796806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79500039b0 0x7f7950003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7950004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79500051c0 0x7f795000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f79680ce2f0 con 0x7f7950004800 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f795000c160 con 0x7f79500051c0 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f795000c360 con 0x7f79500039b0 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7950004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f796cf80640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79500039b0 0x7f7950003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f796d781640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79500051c0 0x7f795000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 -- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79500039b0 msgr2=0x7f7950003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:04.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79500039b0 0x7f7950003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 -- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79500051c0 msgr2=0x7f795000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:04.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79500051c0 0x7f795000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f795ffff640 1 -- 172.21.15.119:0/1537129138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7950003520 con 0x7f7950004800 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f796d781640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79500051c0 0x7f795000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.185+0000 7f796d781640 1 -- 172.21.15.119:0/1537129138 reap_dead start 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.186+0000 7f795ffff640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7950004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f795800c210 tx=0x7f7950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5298a122fa94d870 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.186+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958007d30 con 0x7f7950004800 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.186+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79580058d0 con 0x7f7950004800 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.186+0000 7f795f7fe640 1 -- 172.21.15.119:0/1537129138 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958005d20 con 0x7f7950004800 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 -- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 msgr2=0x7f7950004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7950004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f795800c210 tx=0x7f7950005830 comp rx=0 tx=0).stop 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 -- 172.21.15.119:0/1537129138 shutdown_connections 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 --2- 172.21.15.119:0/1537129138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7950004c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 -- 172.21.15.119:0/1537129138 >> 172.21.15.119:0/1537129138 conn(0x7f79680b3de0 msgr2=0x7f79680b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 -- 172.21.15.119:0/1537129138 shutdown_connections 2024-09-12T02:34:04.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.187+0000 7f796f1e4640 1 -- 172.21.15.119:0/1537129138 wait complete. 2024-09-12T02:34:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.188+0000 7f796f1e4640 1 Processor -- start 2024-09-12T02:34:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.188+0000 7f796f1e4640 1 -- start start 2024-09-12T02:34:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79680cb790 0x7f796815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 0x7f796815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f79680d0ad0 con 0x7f7950004800 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79680d0640 con 0x7f79680cbbf0 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796f1e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f79680d0c50 con 0x7f79680cb790 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42790/0 (socket says 172.21.15.119:42790) 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 -- 172.21.15.119:0/3856530768 learned_addr learned my addr 172.21.15.119:0/3856530768 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796d781640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 0x7f796815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f795ffff640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79680cb790 0x7f796815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 -- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79680cb790 msgr2=0x7f796815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79680cb790 0x7f796815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 -- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 msgr2=0x7f796815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 0x7f796815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 -- 172.21.15.119:0/3856530768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79680ca410 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796d781640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 0x7f796815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f796cf80640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f796400f820 tx=0x7f796400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.189+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640050d0 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.190+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964018070 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.190+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79680ca6f0 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.190+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964005490 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.190+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79680cacb0 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.191+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79680d1040 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.191+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f796400d730 con 0x7f7950004800 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.191+0000 7f795d7fa640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 0x7f795406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:04.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.192+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f796408b000 con 0x7f7950004800 2024-09-12T02:34:04.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.192+0000 7f795ffff640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 0x7f795406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:04.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.192+0000 7f795ffff640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 0x7f795406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7958033000 tx=0x7f795802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:04.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.196+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7964059690 con 0x7f7950004800 2024-09-12T02:34:04.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:04.363+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f796806d120 con 0x7f7950004800 2024-09-12T02:34:05.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.059+0000 7f795d7fa640 1 -- 172.21.15.119:0/3856530768 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f7964058f90 con 0x7f7950004800 2024-09-12T02:34:05.060 INFO:teuthology.orchestra.run.smithi119.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T02:34:05.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.063+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 msgr2=0x7f795406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.063+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 0x7f795406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7958033000 tx=0x7f795802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:05.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.064+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 msgr2=0x7f7968148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.064+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f796400f820 tx=0x7f796400fce0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 shutdown_connections 2024-09-12T02:34:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f795406be30 0x7f795406e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680cbbf0 0x7f796815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79680cb790 0x7f796815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 --2- 172.21.15.119:0/3856530768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7950004800 0x7f7968148e10 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f796400f820 tx=0x7f796400fce0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.072+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 >> 172.21.15.119:0/3856530768 conn(0x7f79680b3de0 msgr2=0x7f79680b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.073+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 shutdown_connections 2024-09-12T02:34:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.073+0000 7f796f1e4640 1 -- 172.21.15.119:0/3856530768 wait complete. 2024-09-12T02:34:05.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T02:34:05.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.194+0000 7fd4367f6640 1 Processor -- start 2024-09-12T02:34:05.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.194+0000 7fd4367f6640 1 -- start start 2024-09-12T02:34:05.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd4367f6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4300d5100 0x7fd4300cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd4367f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd4367f6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4300d3a60 con 0x7fd43015e640 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd4367f6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd4300cec40 con 0x7fd4300d5100 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd4367f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd4300cef20 con 0x7fd4301621b0 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4300d5100 0x7fd4300cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4300d5100 0x7fd4300cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42792/0 (socket says 172.21.15.119:42792) 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 -- 172.21.15.119:0/241805282 learned_addr learned my addr 172.21.15.119:0/241805282 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd434d93640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 -- 172.21.15.119:0/241805282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4301621b0 msgr2=0x7fd430162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 -- 172.21.15.119:0/241805282 >> v1:172.21.15.119:6789/0 conn(0x7fd43015e640 legacy=0x7fd4300d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42f7fe640 1 -- 172.21.15.119:0/241805282 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4300cf200 con 0x7fd4300d5100 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.195+0000 7fd42effd640 1 -- 172.21.15.119:0/241805282 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200882094 0 0) 0x7fd4300d3a60 con 0x7fd43015e640 2024-09-12T02:34:05.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd42f7fe640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd4300cfa00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3862b31e4e311f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:05.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd42effd640 1 -- 172.21.15.119:0/241805282 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424037070 con 0x7fd4300d5100 2024-09-12T02:34:05.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd42effd640 1 -- 172.21.15.119:0/241805282 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42402ae50 con 0x7fd4300d5100 2024-09-12T02:34:05.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd42effd640 1 -- 172.21.15.119:0/241805282 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424032860 con 0x7fd4300d5100 2024-09-12T02:34:05.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 -- 172.21.15.119:0/241805282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 msgr2=0x7fd4300cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd4300cfa00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402a300 comp rx=0 tx=0).stop 2024-09-12T02:34:05.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 -- 172.21.15.119:0/241805282 shutdown_connections 2024-09-12T02:34:05.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 --2- 172.21.15.119:0/241805282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd4300cfa00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 -- 172.21.15.119:0/241805282 >> 172.21.15.119:0/241805282 conn(0x7fd43008bfc0 msgr2=0x7fd4300d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:05.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 -- 172.21.15.119:0/241805282 shutdown_connections 2024-09-12T02:34:05.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.196+0000 7fd4367f6640 1 -- 172.21.15.119:0/241805282 wait complete. 2024-09-12T02:34:05.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 Processor -- start 2024-09-12T02:34:05.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 -- start start 2024-09-12T02:34:05.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd43015e640 0x7fd43015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd4300cff40 con 0x7fd4300d5100 2024-09-12T02:34:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd43015ea20 con 0x7fd4301621b0 2024-09-12T02:34:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.198+0000 7fd4367f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd4300d00c0 con 0x7fd43015e640 2024-09-12T02:34:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42800/0 (socket says 172.21.15.119:42800) 2024-09-12T02:34:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 -- 172.21.15.119:0/3704051993 learned_addr learned my addr 172.21.15.119:0/3704051993 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 -- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd43015e640 msgr2=0x7fd43015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd43015e640 0x7fd43015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd434d93640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 -- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 msgr2=0x7fd430162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 -- 172.21.15.119:0/3704051993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4300b67e0 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd434d93640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42ffff640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c4e0 tx=0x7fd42000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420017070 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4200035f0 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4300b6ac0 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200039e0 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.199+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4300c9370 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.200+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4300cfa00 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.201+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd42001a070 con 0x7fd4300d5100 2024-09-12T02:34:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.201+0000 7fd42cff9640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 0x7fd41c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.201+0000 7fd42f7fe640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 0x7fd41c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.201+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fd42008a410 con 0x7fd4300d5100 2024-09-12T02:34:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.201+0000 7fd42f7fe640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 0x7fd41c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd424034000 tx=0x7fd42402c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.205+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd420058450 con 0x7fd4300d5100 2024-09-12T02:34:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:05.410+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd4300d3cf0 con 0x7fd4300d5100 2024-09-12T02:34:06.024 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-09-12T02:34:06.023+0000 7fae07a69640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:34:06.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.095+0000 7fd42cff9640 1 -- 172.21.15.119:0/3704051993 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fd42005c750 con 0x7fd4300d5100 2024-09-12T02:34:06.096 INFO:teuthology.orchestra.run.smithi119.stderr:added data pool 4 to fsmap 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 msgr2=0x7fd41c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 0x7fd41c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd424034000 tx=0x7fd42402c000 comp rx=0 tx=0).stop 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 msgr2=0x7fd43015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c4e0 tx=0x7fd42000c9a0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 shutdown_connections 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd41c06be30 0x7fd41c06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4301621b0 0x7fd430162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd43015e640 0x7fd43015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 --2- 172.21.15.119:0/3704051993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4300d5100 0x7fd43015c3b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 >> 172.21.15.119:0/3704051993 conn(0x7fd43008bfc0 msgr2=0x7fd43015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 shutdown_connections 2024-09-12T02:34:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.097+0000 7fd4367f6640 1 -- 172.21.15.119:0/3704051993 wait complete. 2024-09-12T02:34:06.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:06.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.212+0000 7fa93f5ed640 1 Processor -- start 2024-09-12T02:34:06.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.212+0000 7fa93f5ed640 1 -- start start 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93f5ed640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa93815e5f0 0x7fa9380d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93f5ed640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa93806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93f5ed640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9380d3690 con 0x7fa9380d30f0 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93f5ed640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa93806d530 con 0x7fa93815e5f0 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93f5ed640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa9380d3970 con 0x7fa9380b6690 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93cb88640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa9380d30f0 0x7fa9380b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33754/0 (socket says 172.21.15.119:33754) 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93cb88640 1 -- 172.21.15.119:0/2562633999 learned_addr learned my addr 172.21.15.119:0/2562633999 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93db8a640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa93806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa93d389640 1 --2- 172.21.15.119:0/2562633999 >> v2:172.21.15.153:3300/0 conn(0x7fa93815e5f0 0x7fa9380d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775095334 0 0) 0x7fa9380d3690 con 0x7fa9380d30f0 2024-09-12T02:34:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.213+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa924003520 con 0x7fa9380d30f0 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532038558 0 0) 0x7fa924003520 con 0x7fa9380d30f0 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 msgr2=0x7fa93806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa93806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 >> v2:172.21.15.153:3300/0 conn(0x7fa93815e5f0 msgr2=0x7fa9380d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 --2- 172.21.15.119:0/2562633999 >> v2:172.21.15.153:3300/0 conn(0x7fa93815e5f0 0x7fa9380d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93806cee0 con 0x7fa9380d30f0 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fa928001690 con 0x7fa9380d30f0 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 >> v1:172.21.15.119:6789/0 conn(0x7fa9380d30f0 legacy=0x7fa9380b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa924003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa924004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924004d40 0x7fa9240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa93806d530 con 0x7fa9240039b0 2024-09-12T02:34:06.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9380d3970 con 0x7fa924004d40 2024-09-12T02:34:06.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa92400b9c0 con 0x7fa9380b6690 2024-09-12T02:34:06.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa924003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93cb88640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa924004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93db8a640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924004d40 0x7fa9240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 -- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 msgr2=0x7fa924004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9380b6690 0x7fa924004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 -- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924004d40 msgr2=0x7fa9240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924004d40 0x7fa9240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93d389640 1 -- 172.21.15.119:0/2562633999 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924003520 con 0x7fa9240039b0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.214+0000 7fa93db8a640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924004d40 0x7fa9240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93d389640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa924003dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa934009af0 tx=0x7fa924005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f765357e4dae3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934036070 con 0x7fa9240039b0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa934031400 con 0x7fa9240039b0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa92ffff640 1 -- 172.21.15.119:0/2562633999 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934009690 con 0x7fa9240039b0 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2562633999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 msgr2=0x7fa924003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2562633999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa924003dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa934009af0 tx=0x7fa924005830 comp rx=0 tx=0).stop 2024-09-12T02:34:06.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93db8a640 1 -- 172.21.15.119:0/2562633999 reap_dead start 2024-09-12T02:34:06.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2562633999 shutdown_connections 2024-09-12T02:34:06.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.215+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2562633999 >> 172.21.15.119:0/2562633999 conn(0x7fa93808bfc0 msgr2=0x7fa9380d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.216+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2562633999 shutdown_connections 2024-09-12T02:34:06.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.216+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2562633999 wait complete. 2024-09-12T02:34:06.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 Processor -- start 2024-09-12T02:34:06.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 -- start start 2024-09-12T02:34:06.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 0x7fa9380c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa938161140 0x7fa9381615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9380d5310 con 0x7fa9240039b0 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa93815e9d0 con 0x7fa9380c9750 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.217+0000 7fa93f5ed640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa93806d9c0 con 0x7fa938161140 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42818/0 (socket says 172.21.15.119:42818) 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 -- 172.21.15.119:0/2610321116 learned_addr learned my addr 172.21.15.119:0/2610321116 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93db8a640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa938161140 0x7fa9381615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 -- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa938161140 msgr2=0x7fa9381615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa938161140 0x7fa9381615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93cb88640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 0x7fa9380c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 -- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 msgr2=0x7fa9380c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 0x7fa9380c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 -- 172.21.15.119:0/2610321116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9381f4540 con 0x7fa9240039b0 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93cb88640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 0x7fa9380c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93d389640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa934009af0 tx=0x7fa934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934041020 con 0x7fa9240039b0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93402ade0 con 0x7fa9240039b0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9381f47e0 con 0x7fa9240039b0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934036040 con 0x7fa9240039b0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.218+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9381f4da0 con 0x7fa9240039b0 2024-09-12T02:34:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.219+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9380d4dd0 con 0x7fa9240039b0 2024-09-12T02:34:06.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.220+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa934044020 con 0x7fa9240039b0 2024-09-12T02:34:06.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.220+0000 7fa92dffb640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 0x7fa91c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.220+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa9340ab630 con 0x7fa9240039b0 2024-09-12T02:34:06.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.220+0000 7fa93cb88640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 0x7fa91c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.221+0000 7fa93cb88640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 0x7fa91c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa928000c00 tx=0x7fa928009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.225+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa93404b030 con 0x7fa9240039b0 2024-09-12T02:34:06.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.428+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9380b23e0 con 0x7fa9240039b0 2024-09-12T02:34:06.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.428+0000 7fa92dffb640 1 -- 172.21.15.119:0/2610321116 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5219 (secure 0 0 0) 0x7fa934079d30 con 0x7fa9240039b0 2024-09-12T02:34:06.430 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:06.430 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":6,"btime":"2024-09-12T02:34:06:086139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:05.412086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 6 2024-09-12T02:34:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 msgr2=0x7fa91c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 0x7fa91c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa928000c00 tx=0x7fa928009040 comp rx=0 tx=0).stop 2024-09-12T02:34:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 msgr2=0x7fa938157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa934009af0 tx=0x7fa934004730 comp rx=0 tx=0).stop 2024-09-12T02:34:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 shutdown_connections 2024-09-12T02:34:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa91c06be30 0x7fa91c06e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa938161140 0x7fa9381615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9380c9750 0x7fa9380c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 --2- 172.21.15.119:0/2610321116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9240039b0 0x7fa938157880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 >> 172.21.15.119:0/2610321116 conn(0x7fa93808bfc0 msgr2=0x7fa9380b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 shutdown_connections 2024-09-12T02:34:06.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.430+0000 7fa93f5ed640 1 -- 172.21.15.119:0/2610321116 wait complete. 2024-09-12T02:34:06.443 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:06.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.540+0000 7f8ca6da2640 1 Processor -- start 2024-09-12T02:34:06.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 -- start start 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ca015b300 0x7f8ca00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8ca00af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca00b02a0 con 0x7f8ca009ab10 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca015b6e0 con 0x7f8ca015b300 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca6da2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00b08e0 con 0x7f8ca00b4600 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.541+0000 7f8ca559f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8ca009ab10 0x7f8ca00b13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33762/0 (socket says 172.21.15.119:33762) 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca559f640 1 -- 172.21.15.119:0/536234815 learned_addr learned my addr 172.21.15.119:0/536234815 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763787126 0 0) 0x7f8ca00b02a0 con 0x7f8ca009ab10 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca65a1640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8ca00af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c88003520 con 0x7f8ca009ab10 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/536234815 >> v2:172.21.15.153:3300/0 conn(0x7f8ca015b300 0x7f8ca00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1006833497 0 0) 0x7f8c88003520 con 0x7f8ca009ab10 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 msgr2=0x7f8ca00af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8ca00af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 >> v2:172.21.15.153:3300/0 conn(0x7f8ca015b300 msgr2=0x7f8ca00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 --2- 172.21.15.119:0/536234815 >> v2:172.21.15.153:3300/0 conn(0x7f8ca015b300 0x7f8ca00b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00b0bc0 con 0x7f8ca009ab10 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f8c94001670 con 0x7f8ca009ab10 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 >> v1:172.21.15.119:6789/0 conn(0x7f8ca009ab10 legacy=0x7f8ca00b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8c880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca015b6e0 con 0x7f8c880039b0 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b08e0 con 0x7f8c88004800 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8800b9c0 con 0x7f8ca00b4600 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca559f640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca65a1640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8c880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 -- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 msgr2=0x7f8c880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8c880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 -- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88004800 msgr2=0x7f8c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca5da0640 1 -- 172.21.15.119:0/536234815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c88003520 con 0x7f8c880039b0 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.542+0000 7f8ca65a1640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca00b4600 0x7f8c880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.543+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009fc0 tx=0x7f8c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86832e9c02c7a29d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.543+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90009c10 con 0x7f8c880039b0 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.543+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c90036070 con 0x7f8c880039b0 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.543+0000 7f8ca4d9e640 1 -- 172.21.15.119:0/536234815 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9002d070 con 0x7f8c880039b0 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 -- 172.21.15.119:0/536234815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c880039b0 msgr2=0x7f8c88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/536234815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009fc0 tx=0x7f8c88005830 comp rx=0 tx=0).stop 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca65a1640 1 -- 172.21.15.119:0/536234815 reap_dead start 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 -- 172.21.15.119:0/536234815 shutdown_connections 2024-09-12T02:34:06.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 -- 172.21.15.119:0/536234815 >> 172.21.15.119:0/536234815 conn(0x7f8ca00732d0 msgr2=0x7f8ca00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 -- 172.21.15.119:0/536234815 shutdown_connections 2024-09-12T02:34:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.544+0000 7f8ca6da2640 1 -- 172.21.15.119:0/536234815 wait complete. 2024-09-12T02:34:06.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.545+0000 7f8ca6da2640 1 Processor -- start 2024-09-12T02:34:06.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.545+0000 7f8ca6da2640 1 -- start start 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c880039b0 0x7f8ca0146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca014d880 0x7f8ca014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00af850 con 0x7f8ca014bcf0 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b0580 con 0x7f8ca014d880 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00af9d0 con 0x7f8c880039b0 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42832/0 (socket says 172.21.15.119:42832) 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 -- 172.21.15.119:0/2920193665 learned_addr learned my addr 172.21.15.119:0/2920193665 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 -- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c880039b0 msgr2=0x7f8ca0146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c880039b0 0x7f8ca0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 -- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca014d880 msgr2=0x7f8ca014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca014d880 0x7f8ca014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 -- 172.21.15.119:0/2920193665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00cd440 con 0x7f8ca014bcf0 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca559f640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c94000c00 tx=0x7f8c940077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400f940 con 0x7f8ca014bcf0 2024-09-12T02:34:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c94018070 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00cd720 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400fd20 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.546+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca00cdce0 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.547+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca00afde0 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.548+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c9401d460 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.548+0000 7f8c9e7fc640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.548+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8c9408b1a0 con 0x7f8ca014bcf0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.548+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.549+0000 7f8ca5da0640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c90035000 tx=0x7f8c9002d000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.552+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c94059810 con 0x7f8ca014bcf0 2024-09-12T02:34:06.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.723+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ca01684a0 con 0x7f8ca014bcf0 2024-09-12T02:34:06.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.724+0000 7f8c9e7fc640 1 -- 172.21.15.119:0/2920193665 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18671 (secure 0 0 0) 0x7f8c94059110 con 0x7f8ca014bcf0 2024-09-12T02:34:06.725 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:06.725 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:05.411864+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 msgr2=0x7f8c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c90035000 tx=0x7f8c9002d000 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 msgr2=0x7f8ca014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c94000c00 tx=0x7f8c940077a0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 shutdown_connections 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca014d880 0x7f8ca014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca014bcf0 0x7f8ca014c170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 --2- 172.21.15.119:0/2920193665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c880039b0 0x7f8ca0146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 >> 172.21.15.119:0/2920193665 conn(0x7f8ca00732d0 msgr2=0x7f8ca0152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 shutdown_connections 2024-09-12T02:34:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.726+0000 7f8ca6da2640 1 -- 172.21.15.119:0/2920193665 wait complete. 2024-09-12T02:34:06.738 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.835+0000 7f6450391640 1 Processor -- start 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.835+0000 7f6450391640 1 -- start start 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f6450391640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f6450391640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480cec00 con 0x7f64480b1620 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f6450391640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644809bd90 con 0x7f64480d1090 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f6450391640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64480d0010 con 0x7f644815c520 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f644d92c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f64480b1620 0x7f64480d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33778/0 (socket says 172.21.15.119:33778) 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.836+0000 7f644d92c640 1 -- 172.21.15.119:0/3503520592 learned_addr learned my addr 172.21.15.119:0/3503520592 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644e12d640 1 --2- 172.21.15.119:0/3503520592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124374113 0 0) 0x7f64480cec00 con 0x7f64480b1620 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6434003520 con 0x7f64480b1620 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644e12d640 1 -- 172.21.15.119:0/3503520592 >> v1:172.21.15.153:6789/0 conn(0x7f64480d1090 legacy=0x7f64480cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929707805 0 0) 0x7f6434003520 con 0x7f64480b1620 2024-09-12T02:34:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644e12d640 1 -- 172.21.15.119:0/3503520592 >> v1:172.21.15.119:6789/0 conn(0x7f64480b1620 legacy=0x7f64480d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.837+0000 7f644e12d640 1 -- 172.21.15.119:0/3503520592 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64480d02f0 con 0x7f644815c520 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f644e12d640 1 --2- 172.21.15.119:0/3503520592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809b720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6444009dc0 tx=0x7f644402a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9df5595a3679d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444035020 con 0x7f644815c520 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444007540 con 0x7f644815c520 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f644d12b640 1 -- 172.21.15.119:0/3503520592 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438001670 con 0x7f644815c520 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f6450391640 1 -- 172.21.15.119:0/3503520592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 msgr2=0x7f644809b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f6450391640 1 --2- 172.21.15.119:0/3503520592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809b720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6444009dc0 tx=0x7f644402a580 comp rx=0 tx=0).stop 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f6450391640 1 -- 172.21.15.119:0/3503520592 shutdown_connections 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f6450391640 1 --2- 172.21.15.119:0/3503520592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809b720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.838+0000 7f6450391640 1 -- 172.21.15.119:0/3503520592 >> 172.21.15.119:0/3503520592 conn(0x7f64480d23a0 msgr2=0x7f64480d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.839+0000 7f6450391640 1 -- 172.21.15.119:0/3503520592 shutdown_connections 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.839+0000 7f6450391640 1 -- 172.21.15.119:0/3503520592 wait complete. 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 Processor -- start 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 -- start start 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64480b1620 0x7f64480c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f644815c900 con 0x7f64480d1090 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64480d05d0 con 0x7f64480b1620 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f6450391640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64480cc030 con 0x7f644815c520 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.840+0000 7f644d92c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42838/0 (socket says 172.21.15.119:42838) 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 -- 172.21.15.119:0/1005618458 learned_addr learned my addr 172.21.15.119:0/1005618458 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644e12d640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64480b1620 0x7f64480c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644e92e640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 -- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 msgr2=0x7f644809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 -- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64480b1620 msgr2=0x7f64480c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64480b1620 0x7f64480c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 -- 172.21.15.119:0/1005618458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64480cc2b0 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f644d92c640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f643800c520 tx=0x7f643800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438018070 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6438007500 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64480cc590 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438004a20 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.841+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64480c7620 con 0x7f64480d1090 2024-09-12T02:34:06.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.842+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64480c7160 con 0x7f64480d1090 2024-09-12T02:34:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.843+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f643801b070 con 0x7f64480d1090 2024-09-12T02:34:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.843+0000 7f643effd640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.843+0000 7f644e12d640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.843+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f643808a500 con 0x7f64480d1090 2024-09-12T02:34:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.844+0000 7f644e12d640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 0x7f642c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6444033000 tx=0x7f644402f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:06.847+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64480c7160 con 0x7f64480d1090 2024-09-12T02:34:07.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.013+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f644809b720 con 0x7f64480d1090 2024-09-12T02:34:07.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.014+0000 7f643effd640 1 -- 172.21.15.119:0/1005618458 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18671 (secure 0 0 0) 0x7f6438058b70 con 0x7f64480d1090 2024-09-12T02:34:07.014 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:07.015 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:05.411864+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 msgr2=0x7f642c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 0x7f642c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6444033000 tx=0x7f644402f000 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 msgr2=0x7f64481506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f643800c520 tx=0x7f643800c9e0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 shutdown_connections 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f644815c520 0x7f644809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64480d1090 0x7f64481506f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 --2- 172.21.15.119:0/1005618458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64480b1620 0x7f64480c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 >> 172.21.15.119:0/1005618458 conn(0x7f64480d23a0 msgr2=0x7f64480b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 shutdown_connections 2024-09-12T02:34:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.016+0000 7f6450391640 1 -- 172.21.15.119:0/1005618458 wait complete. 2024-09-12T02:34:07.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:07.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.147+0000 7fa612a53640 1 Processor -- start 2024-09-12T02:34:07.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.147+0000 7fa612a53640 1 -- start start 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa612a53640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 0x7fa60c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa612a53640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa60c06dbd0 0x7fa60c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa612a53640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c0d0780 con 0x7fa60c09b690 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa612a53640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c15eb20 con 0x7fa60c06dbd0 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa612a53640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c06d260 con 0x7fa60c15e740 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa610ff0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa60c06dbd0 0x7fa60c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa60b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa60c09b690 0x7fa60c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33790/0 (socket says 172.21.15.119:33790) 2024-09-12T02:34:07.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa610ff0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa60c06dbd0 0x7fa60c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42852/0 (socket says 172.21.15.119:42852) 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.148+0000 7fa60b7fe640 1 -- 172.21.15.119:0/1410921395 learned_addr learned my addr 172.21.15.119:0/1410921395 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60bfff640 1 --2- 172.21.15.119:0/1410921395 >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 0x7fa60c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa610ff0640 1 -- 172.21.15.119:0/1410921395 >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 msgr2=0x7fa60c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa610ff0640 1 --2- 172.21.15.119:0/1410921395 >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 0x7fa60c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa610ff0640 1 -- 172.21.15.119:0/1410921395 >> v1:172.21.15.119:6789/0 conn(0x7fa60c09b690 legacy=0x7fa60c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa610ff0640 1 -- 172.21.15.119:0/1410921395 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0d0a60 con 0x7fa60c06dbd0 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60affd640 1 -- 172.21.15.119:0/1410921395 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575238398 0 0) 0x7fa60c0d0780 con 0x7fa60c09b690 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60bfff640 1 --2- 172.21.15.119:0/1410921395 >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 0x7fa60c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa610ff0640 1 --2- 172.21.15.119:0/1410921395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c06dbd0 0x7fa60c06cd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa60c074070 tx=0x7fa60402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8666890751c4866d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60affd640 1 -- 172.21.15.119:0/1410921395 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604007740 con 0x7fa60c06dbd0 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60affd640 1 -- 172.21.15.119:0/1410921395 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6040078e0 con 0x7fa60c06dbd0 2024-09-12T02:34:07.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.149+0000 7fa60affd640 1 -- 172.21.15.119:0/1410921395 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604007cb0 con 0x7fa60c06dbd0 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 -- 172.21.15.119:0/1410921395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c06dbd0 msgr2=0x7fa60c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 --2- 172.21.15.119:0/1410921395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c06dbd0 0x7fa60c06cd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa60c074070 tx=0x7fa60402a710 comp rx=0 tx=0).stop 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 -- 172.21.15.119:0/1410921395 shutdown_connections 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 --2- 172.21.15.119:0/1410921395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c06dbd0 0x7fa60c06cd20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 --2- 172.21.15.119:0/1410921395 >> v2:172.21.15.153:3300/0 conn(0x7fa60c15e740 0x7fa60c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 -- 172.21.15.119:0/1410921395 >> 172.21.15.119:0/1410921395 conn(0x7fa60c0d23a0 msgr2=0x7fa60c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 -- 172.21.15.119:0/1410921395 shutdown_connections 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.150+0000 7fa612a53640 1 -- 172.21.15.119:0/1410921395 wait complete. 2024-09-12T02:34:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.151+0000 7fa612a53640 1 Processor -- start 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.151+0000 7fa612a53640 1 -- start start 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 0x7fa60c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa60c09b690 0x7fa60c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c09bac0 con 0x7fa60c15e740 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0d1020 con 0x7fa60c06dbd0 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa612a53640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c06dfe0 con 0x7fa60c09b690 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42862/0 (socket says 172.21.15.119:42862) 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 -- 172.21.15.119:0/3757302033 learned_addr learned my addr 172.21.15.119:0/3757302033 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa60b7fe640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa60c09b690 0x7fa60c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa60bfff640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 0x7fa60c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 -- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa60c09b690 msgr2=0x7fa60c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa60c09b690 0x7fa60c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 -- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 msgr2=0x7fa60c0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 0x7fa60c0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa610ff0640 1 -- 172.21.15.119:0/3757302033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1f56e0 con 0x7fa60c15e740 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.152+0000 7fa60bfff640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 0x7fa60c0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa610ff0640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60402ad00 tx=0x7fa604004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60403f070 con 0x7fa60c15e740 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa604031c90 con 0x7fa60c15e740 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c0c95a0 con 0x7fa60c15e740 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604044680 con 0x7fa60c15e740 2024-09-12T02:34:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.153+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c0c9e40 con 0x7fa60c15e740 2024-09-12T02:34:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.154+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c0d0780 con 0x7fa60c15e740 2024-09-12T02:34:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.154+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa60403b410 con 0x7fa60c15e740 2024-09-12T02:34:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.155+0000 7fa608ff9640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 0x7fa5f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.155+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa6040ac990 con 0x7fa60c15e740 2024-09-12T02:34:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.155+0000 7fa60bfff640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 0x7fa5f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.155+0000 7fa60bfff640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 0x7fa5f806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00aa30 tx=0x7fa5fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.159+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa60407b150 con 0x7fa60c15e740 2024-09-12T02:34:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.361+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60c0d1cb0 con 0x7fa60c15e740 2024-09-12T02:34:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.362+0000 7fa608ff9640 1 -- 172.21.15.119:0/3757302033 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5219 (secure 0 0 0) 0x7fa60407aa50 con 0x7fa60c15e740 2024-09-12T02:34:07.363 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:07.363 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":6,"btime":"2024-09-12T02:34:06:086139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:05.412086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:07.363 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 6 2024-09-12T02:34:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 msgr2=0x7fa5f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 0x7fa5f806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00aa30 tx=0x7fa5fc008040 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 msgr2=0x7fa60c0b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60402ad00 tx=0x7fa604004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 shutdown_connections 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa5f806be30 0x7fa5f806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa60c15e740 0x7fa60c0b5240 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa60c09b690 0x7fa60c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 --2- 172.21.15.119:0/3757302033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa60c06dbd0 0x7fa60c0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 >> 172.21.15.119:0/3757302033 conn(0x7fa60c0d23a0 msgr2=0x7fa60c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 shutdown_connections 2024-09-12T02:34:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.364+0000 7fa612a53640 1 -- 172.21.15.119:0/3757302033 wait complete. 2024-09-12T02:34:07.375 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:07.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 Processor -- start 2024-09-12T02:34:07.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 -- start start 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 0x7f5898070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f589806f0f0 0x7f5898161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5898162530 0x7f5898143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f58981629a0 con 0x7f589806f0f0 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f58980b5130 con 0x7f58980d0380 2024-09-12T02:34:07.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.473+0000 7f589e250640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f589806f5f0 con 0x7f5898162530 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f589806f0f0 0x7f5898161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f589806f0f0 0x7f5898161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42866/0 (socket says 172.21.15.119:42866) 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 -- 172.21.15.119:0/1444770010 learned_addr learned my addr 172.21.15.119:0/1444770010 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f58977fe640 1 --2- 172.21.15.119:0/1444770010 >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 0x7f5898070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f5897fff640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5898162530 0x7f5898143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 -- 172.21.15.119:0/1444770010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5898162530 msgr2=0x7f5898143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5898162530 0x7f5898143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 -- 172.21.15.119:0/1444770010 >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 msgr2=0x7f5898070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 --2- 172.21.15.119:0/1444770010 >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 0x7f5898070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f588ffff640 1 -- 172.21.15.119:0/1444770010 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589806f8d0 con 0x7f589806f0f0 2024-09-12T02:34:07.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.474+0000 7f58977fe640 1 --2- 172.21.15.119:0/1444770010 >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 0x7f5898070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f588ffff640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f589806f0f0 0x7f5898161ff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5898069820 tx=0x7f588002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a76ad0440d86222 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f5896ffd640 1 -- 172.21.15.119:0/1444770010 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880037070 con 0x7f589806f0f0 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f5896ffd640 1 -- 172.21.15.119:0/1444770010 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880032440 con 0x7f589806f0f0 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f5896ffd640 1 -- 172.21.15.119:0/1444770010 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880032810 con 0x7f589806f0f0 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 -- 172.21.15.119:0/1444770010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f589806f0f0 msgr2=0x7f5898161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f589806f0f0 0x7f5898161ff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5898069820 tx=0x7f588002a140 comp rx=0 tx=0).stop 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 -- 172.21.15.119:0/1444770010 shutdown_connections 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5898162530 0x7f5898143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 --2- 172.21.15.119:0/1444770010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f589806f0f0 0x7f5898161ff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 --2- 172.21.15.119:0/1444770010 >> v2:172.21.15.153:3300/0 conn(0x7f58980d0380 0x7f5898070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 -- 172.21.15.119:0/1444770010 >> 172.21.15.119:0/1444770010 conn(0x7f589806bc10 msgr2=0x7f589806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 -- 172.21.15.119:0/1444770010 shutdown_connections 2024-09-12T02:34:07.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.475+0000 7f589e250640 1 -- 172.21.15.119:0/1444770010 wait complete. 2024-09-12T02:34:07.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 Processor -- start 2024-09-12T02:34:07.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 -- start start 2024-09-12T02:34:07.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 0x7f58980c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58980d0380 0x7f58981f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5898147ea0 con 0x7f5898162530 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f589806fe90 con 0x7f589806f0f0 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f589e250640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58980d0760 con 0x7f58980d0380 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f5897fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f5897fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42882/0 (socket says 172.21.15.119:42882) 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.477+0000 7f5897fff640 1 -- 172.21.15.119:0/1223403291 learned_addr learned my addr 172.21.15.119:0/1223403291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f588ffff640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58980d0380 0x7f58981f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f58977fe640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 0x7f58980c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 -- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58980d0380 msgr2=0x7f58981f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58980d0380 0x7f58981f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 -- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 msgr2=0x7f58980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 0x7f58980c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 -- 172.21.15.119:0/1223403291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5898144890 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f58977fe640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 0x7f58980c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5897fff640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5890007e40 tx=0x7f589000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890014620 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5890019070 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5898144b70 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890014a20 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.478+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5898145130 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.479+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5898161ff0 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.480+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5890014bc0 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.480+0000 7f5894ff9640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 0x7f587806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.480+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f589008b920 con 0x7f5898162530 2024-09-12T02:34:07.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.480+0000 7f58977fe640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 0x7f587806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:07.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.480+0000 7f58977fe640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 0x7f587806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5888006fd0 tx=0x7f5888008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:07.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.484+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5890059f90 con 0x7f5898162530 2024-09-12T02:34:07.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.650+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58980b60d0 con 0x7f5898162530 2024-09-12T02:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.651+0000 7f5894ff9640 1 -- 172.21.15.119:0/1223403291 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f5890059890 con 0x7f5898162530 2024-09-12T02:34:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:07.652 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 msgr2=0x7f587806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 0x7f587806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5888006fd0 tx=0x7f5888008040 comp rx=0 tx=0).stop 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 msgr2=0x7f58981f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5890007e40 tx=0x7f589000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 shutdown_connections 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f587806be30 0x7f587806e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5898162530 0x7f58981f7d30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58980d0380 0x7f58981f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 --2- 172.21.15.119:0/1223403291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f589806f0f0 0x7f58980c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 >> 172.21.15.119:0/1223403291 conn(0x7f589806bc10 msgr2=0x7f589806e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 shutdown_connections 2024-09-12T02:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:07.653+0000 7f589e250640 1 -- 172.21.15.119:0/1223403291 wait complete. 2024-09-12T02:34:08.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:34:00.381345+0000', 'modified': '2024-09-12T02:34:05.412086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/29298975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 29298975}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 29298975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-09-12T02:34:08.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:34:08.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:34:08.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.168+0000 7f5ad819f640 1 Processor -- start 2024-09-12T02:34:08.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.168+0000 7f5ad819f640 1 -- start start 2024-09-12T02:34:08.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad819f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ad00cf330 0x7f5ad0169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad819f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad006e820 con 0x7f5ad0161a20 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad819f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad00cf980 con 0x7f5ad00d15f0 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad819f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad00cf760 con 0x7f5ad00cf330 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad5f3b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5ad0161a20 0x7f5ad00d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38396/0 (socket says 172.21.15.119:38396) 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad673c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ad00cf330 0x7f5ad0169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/2361610237 learned_addr learned my addr 172.21.15.119:0/2361610237 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad673c640 1 -- 172.21.15.119:0/2361610237 >> v1:172.21.15.153:6789/0 conn(0x7f5ad00d15f0 legacy=0x7f5ad00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad673c640 1 -- 172.21.15.119:0/2361610237 >> v1:172.21.15.119:6789/0 conn(0x7f5ad0161a20 legacy=0x7f5ad00d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.169+0000 7f5ad673c640 1 -- 172.21.15.119:0/2361610237 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad006d050 con 0x7f5ad00cf330 2024-09-12T02:34:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad673c640 1 --2- 172.21.15.119:0/2361610237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0169070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009d90 tx=0x7f5ac802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e5c939aa67a08a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad4f39640 1 -- 172.21.15.119:0/2361610237 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007740 con 0x7f5ad00cf330 2024-09-12T02:34:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad4f39640 1 -- 172.21.15.119:0/2361610237 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac80078e0 con 0x7f5ad00cf330 2024-09-12T02:34:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad4f39640 1 -- 172.21.15.119:0/2361610237 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007cb0 con 0x7f5ad00cf330 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 -- 172.21.15.119:0/2361610237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 msgr2=0x7f5ad0169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 --2- 172.21.15.119:0/2361610237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0169070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009d90 tx=0x7f5ac802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 -- 172.21.15.119:0/2361610237 shutdown_connections 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 --2- 172.21.15.119:0/2361610237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0169070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 -- 172.21.15.119:0/2361610237 >> 172.21.15.119:0/2361610237 conn(0x7f5ad009d850 msgr2=0x7f5ad008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 -- 172.21.15.119:0/2361610237 shutdown_connections 2024-09-12T02:34:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.170+0000 7f5ad819f640 1 -- 172.21.15.119:0/2361610237 wait complete. 2024-09-12T02:34:08.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.171+0000 7f5ad819f640 1 Processor -- start 2024-09-12T02:34:08.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 -- start start 2024-09-12T02:34:08.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ad00d15f0 0x7f5ad015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 0x7f5ad0157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00cff00 con 0x7f5ad00cf330 2024-09-12T02:34:08.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0161e00 con 0x7f5ad0161a20 2024-09-12T02:34:08.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad819f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad006d2f0 con 0x7f5ad00d15f0 2024-09-12T02:34:08.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad5f3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad5f3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33158/0 (socket says 172.21.15.119:33158) 2024-09-12T02:34:08.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3636535812 learned_addr learned my addr 172.21.15.119:0/3636535812 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad673c640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 0x7f5ad0157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.172+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ad00d15f0 0x7f5ad015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ad00d15f0 msgr2=0x7f5ad015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ad00d15f0 0x7f5ad015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 msgr2=0x7f5ad0157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 0x7f5ad0157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3636535812 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0154130 con 0x7f5ad00cf330 2024-09-12T02:34:08.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad673c640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 0x7f5ad0157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:08.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c3f0 tx=0x7f5acc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ac67fc640 1 -- 172.21.15.119:0/3636535812 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc017070 con 0x7f5ad00cf330 2024-09-12T02:34:08.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ac67fc640 1 -- 172.21.15.119:0/3636535812 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc005ce0 con 0x7f5ad00cf330 2024-09-12T02:34:08.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad015b550 con 0x7f5ad00cf330 2024-09-12T02:34:08.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ac67fc640 1 -- 172.21.15.119:0/3636535812 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0072f0 con 0x7f5ad00cf330 2024-09-12T02:34:08.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.173+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad01598a0 con 0x7f5ad00cf330 2024-09-12T02:34:08.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.174+0000 7f5ac67fc640 1 -- 172.21.15.119:0/3636535812 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5acc01a070 con 0x7f5ad00cf330 2024-09-12T02:34:08.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.175+0000 7f5ac67fc640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 0x7f5ab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.175+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 0x7f5ab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.175+0000 7f5ac67fc640 1 -- 172.21.15.119:0/3636535812 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5acc08a4c0 con 0x7f5ad00cf330 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.175+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 0x7f5ab406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0007fd0 tx=0x7f5ac0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.176+0000 7f5adb01c740 1 Processor -- start 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.176+0000 7f5adb01c740 1 -- start start 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59ba80 0x559dea59e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559dea500520 con 0x559dea59fa50 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559dea4a83e0 con 0x559dea59ba80 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x559dea4fc4e0 con 0x559dea59e2c0 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33162/0 (socket says 172.21.15.119:33162) 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 -- 172.21.15.119:0/890704382 learned_addr learned my addr 172.21.15.119:0/890704382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad573a640 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59ba80 0x559dea59e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 -- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 msgr2=0x559dea5e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5e3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 -- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59ba80 msgr2=0x559dea59e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59ba80 0x559dea59e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 -- 172.21.15.119:0/890704382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dea4c32f0 con 0x559dea59fa50 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.177+0000 7f5ad673c640 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e80 tx=0x7f5ac802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a202b802b8f52b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5ab37fe640 1 -- 172.21.15.119:0/890704382 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007ab0 con 0x559dea59fa50 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5ab37fe640 1 -- 172.21.15.119:0/890704382 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8041070 con 0x559dea59fa50 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5ab37fe640 1 -- 172.21.15.119:0/890704382 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007e50 con 0x559dea59fa50 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 -- 172.21.15.119:0/890704382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 msgr2=0x559dea5988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e80 tx=0x7f5ac802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 -- 172.21.15.119:0/890704382 shutdown_connections 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea5988b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59ba80 0x559dea59e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 --2- 172.21.15.119:0/890704382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 -- 172.21.15.119:0/890704382 >> 172.21.15.119:0/890704382 conn(0x559dea59aa80 msgr2=0x559dea5e2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 -- 172.21.15.119:0/890704382 shutdown_connections 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.178+0000 7f5adb01c740 1 -- 172.21.15.119:0/890704382 wait complete. 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.179+0000 7f5adb01c740 1 -- start start 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.179+0000 7f5adb01c740 1 Processor -- start 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59fa50 0x559dea5c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 0x559dea5c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559dea599f20 con 0x559dea59e2c0 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559dea489450 con 0x559dea5c0bc0 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x559dea5e4290 con 0x559dea59fa50 2024-09-12T02:34:08.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 10 client.0 _ll_register_callbacks cb 0x559dea212ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33168/0 (socket says 172.21.15.119:33168) 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3787326523 learned_addr learned my addr 172.21.15.119:0/3787326523 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad673c640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 0x559dea5c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59fa50 0x559dea5c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59fa50 msgr2=0x559dea5c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59fa50 0x559dea5c0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 msgr2=0x559dea5c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 0x559dea5c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 -- 172.21.15.119:0/3787326523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dea2132d0 con 0x559dea59e2c0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad673c640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 0x559dea5c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5acc054840 tx=0x7f5acc058c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c756bf2103ce5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ab0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc060d80 con 0x559dea59e2c0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5acc007490 con 0x559dea59e2c0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.180+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac8041070 con 0x559dea59e2c0 2024-09-12T02:34:08.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5acc007690 con 0x559dea59e2c0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 10 client.4383 fetch_fsmap learned FSMap version 6 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x559dea2dd6b0 con 0x559dea59e2c0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8041070 con 0x559dea59e2c0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f5acc0701c0 con 0x559dea59e2c0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 10 client.4383 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 10 client.4383 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 20 client.4383 populate_metadata read hostname 'smithi119' 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea5c82a0 0x559dea5c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 4 client.4383 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 --> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dea50dc50 con 0x559dea5c82a0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea5c82a0 0x559dea5c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ab0ff9640 10 client.4383 ms_handle_connect on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.181+0000 7f5ad573a640 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea5c82a0 0x559dea5c8680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92892fe48f2c2767 server_cookie=47ab410f59cccb72 in_seq=0 out_seq=0 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/3787326523 <== mds.0 v2:172.21.15.153:6833/29298975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dea50dc50 con 0x559dea5c82a0 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5ab0ff9640 10 client.4383 handle_command_reply: tid=0 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 client.4383 shutdown 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 msgr2=0x559dea5bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5acc054840 tx=0x7f5acc058c80 comp rx=0 tx=0).stop 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 shutdown_connections 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea5c0bc0 0x559dea5c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59fa50 0x559dea5c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea5c82a0 0x559dea5c8680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 --2- 172.21.15.119:0/3787326523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59e2c0 0x559dea5bf0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 >> 172.21.15.119:0/3787326523 conn(0x559dea59ba80 msgr2=0x559dea5e1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5ab0ff9640 0 client.4383 ms_handle_reset on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:08.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 shutdown_connections 2024-09-12T02:34:08.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.182+0000 7f5adb01c740 1 -- 172.21.15.119:0/3787326523 wait complete. 2024-09-12T02:34:08.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.183+0000 7f5adb01c740 20 client.4383 trim_cache size 0 max 16384 2024-09-12T02:34:08.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.200+0000 7f5adb01c740 1 Processor -- start 2024-09-12T02:34:08.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.200+0000 7f5adb01c740 1 -- start start 2024-09-12T02:34:08.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59fa50 0x559dea5e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad02010f0 con 0x559dea5c0bc0 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0200480 con 0x559dea59fa50 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad0200ad0 con 0x559dea59e2c0 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33172/0 (socket says 172.21.15.119:33172) 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 -- 172.21.15.119:0/1388968011 learned_addr learned my addr 172.21.15.119:0/1388968011 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 -- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 msgr2=0x559dea5b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 -- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59fa50 msgr2=0x559dea5e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59fa50 0x559dea5e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 -- 172.21.15.119:0/1388968011 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dea59a820 con 0x559dea5c0bc0 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ad673c640 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ac802a6e0 tx=0x7f5ac8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c993f29cfd37fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.201+0000 7f5ab2ffd640 1 -- 172.21.15.119:0/1388968011 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8003b90 con 0x559dea5c0bc0 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5ab2ffd640 1 -- 172.21.15.119:0/1388968011 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8041070 con 0x559dea5c0bc0 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5ab2ffd640 1 -- 172.21.15.119:0/1388968011 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80078b0 con 0x559dea5c0bc0 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 -- 172.21.15.119:0/1388968011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 msgr2=0x559dea5fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ac802a6e0 tx=0x7f5ac8009750 comp rx=0 tx=0).stop 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 -- 172.21.15.119:0/1388968011 shutdown_connections 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea5c0bc0 0x559dea5fbce0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59fa50 0x559dea5e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 --2- 172.21.15.119:0/1388968011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea59e2c0 0x559dea5b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 -- 172.21.15.119:0/1388968011 >> 172.21.15.119:0/1388968011 conn(0x559dea59ba80 msgr2=0x559dea5dfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 -- 172.21.15.119:0/1388968011 shutdown_connections 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.202+0000 7f5adb01c740 1 -- 172.21.15.119:0/1388968011 wait complete. 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.203+0000 7f5adb01c740 1 -- start start 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.203+0000 7f5adb01c740 1 Processor -- start 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59e2c0 0x559dea5c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea5c0bc0 0x559dea649a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559dea5bf5e0 con 0x559dea59fa50 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559dea5e7600 con 0x559dea59e2c0 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x559dea5c6e70 con 0x559dea5c0bc0 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 10 client.0 _ll_register_callbacks cb 0x7f5acc058010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33186/0 (socket says 172.21.15.119:33186) 2024-09-12T02:34:08.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 -- 172.21.15.119:0/4207003815 learned_addr learned my addr 172.21.15.119:0/4207003815 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59e2c0 0x559dea5c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad673c640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea5c0bc0 0x559dea649a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 -- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea5c0bc0 msgr2=0x559dea649a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea5c0bc0 0x559dea649a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 -- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59e2c0 msgr2=0x559dea5c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59e2c0 0x559dea5c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 -- 172.21.15.119:0/4207003815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dea5e3060 con 0x559dea59fa50 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ad573a640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x559dea5c7670 tx=0x7f5ac0000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7ed89c8f846b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ab0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0005430 con 0x559dea59fa50 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5ac0010040 con 0x559dea59fa50 2024-09-12T02:34:08.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac8041070 con 0x559dea59fa50 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5ac0003ac0 con 0x559dea59fa50 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 10 client.4389 fetch_fsmap learned FSMap version 6 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.204+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x559dea5c86b0 con 0x559dea59fa50 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8041070 con 0x559dea59fa50 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f5ac002c020 con 0x559dea59fa50 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 10 client.4389 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 20 client.4389 populate_metadata read hostname 'smithi119' 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea661600 0x559dea5e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 4 client.4389 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 --> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] -- command(tid 0: {"prefix": "status"}) -- 0x559dea507fa0 con 0x559dea661600 2024-09-12T02:34:08.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea661600 0x559dea5e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ab0ff9640 10 client.4389 ms_handle_connect on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ad5f3b640 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea661600 0x559dea5e4a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6554b055a0f4ee7 server_cookie=292fdbd36553732f in_seq=0 out_seq=0 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ab0ff9640 1 -- 172.21.15.119:0/4207003815 <== mds.0 v2:172.21.15.153:6833/29298975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x559dea507fa0 con 0x559dea661600 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.205+0000 7f5ab0ff9640 10 client.4389 handle_command_reply: tid=0 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 client.4389 shutdown 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 msgr2=0x559dea6059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x559dea5c7670 tx=0x7f5ac0000fb0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 shutdown_connections 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x559dea5c0bc0 0x559dea649a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x559dea661600 0x559dea5e4a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dea59fa50 0x559dea6059a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 --2- 172.21.15.119:0/4207003815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559dea59e2c0 0x559dea5c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ab0ff9640 0 client.4389 ms_handle_reset on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 >> 172.21.15.119:0/4207003815 conn(0x559dea59ba80 msgr2=0x559dea5df910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 shutdown_connections 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 1 -- 172.21.15.119:0/4207003815 wait complete. 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5adb01c740 20 client.4389 trim_cache size 0 max 16384 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "3a2846d1-7a08-4c1c-a77f-ac792ab98e22", 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4309, 2024-09-12T02:34:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 7.1653380740000001, 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 6, 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 27, 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 26, 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 13.181273403 2024-09-12T02:34:08.216 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 msgr2=0x7f5ab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 0x7f5ab406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0007fd0 tx=0x7f5ac0009040 comp rx=0 tx=0).stop 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 msgr2=0x7f5ad0153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c3f0 tx=0x7f5acc00c8b0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 shutdown_connections 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5ab406be30 0x7f5ab406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ad0161a20 0x7f5ad0157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ad00d15f0 0x7f5ad015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 --2- 172.21.15.119:0/3636535812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00cf330 0x7f5ad0153bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 >> 172.21.15.119:0/3636535812 conn(0x7f5ad009d850 msgr2=0x7f5ad015cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 shutdown_connections 2024-09-12T02:34:08.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.206+0000 7f5ad819f640 1 -- 172.21.15.119:0/3636535812 wait complete. 2024-09-12T02:34:08.219 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:34:08.219 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:08.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:34:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.316+0000 7fdac89f6640 1 Processor -- start 2024-09-12T02:34:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.316+0000 7fdac89f6640 1 -- start start 2024-09-12T02:34:08.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.316+0000 7fdac89f6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdac415e760 0x7fdac406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac89f6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdac40cfcc0 0x7fdac40d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac89f6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac40d2700 con 0x7fdac40d4fd0 2024-09-12T02:34:08.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac89f6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40cedb0 con 0x7fdac415e760 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac89f6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40cf090 con 0x7fdac40cfcc0 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdac415e760 0x7fdac406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdac415e760 0x7fdac406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33200/0 (socket says 172.21.15.119:33200) 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 -- 172.21.15.119:0/2957519029 learned_addr learned my addr 172.21.15.119:0/2957519029 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 -- 172.21.15.119:0/2957519029 >> v2:172.21.15.153:3300/0 conn(0x7fdac40cfcc0 msgr2=0x7fdac40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac2d9d640 1 --2- 172.21.15.119:0/2957519029 >> v2:172.21.15.153:3300/0 conn(0x7fdac40cfcc0 0x7fdac40d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 --2- 172.21.15.119:0/2957519029 >> v2:172.21.15.153:3300/0 conn(0x7fdac40cfcc0 0x7fdac40d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 -- 172.21.15.119:0/2957519029 >> v1:172.21.15.153:6789/0 conn(0x7fdac40d4fd0 legacy=0x7fdac40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.317+0000 7fdac259c640 1 -- 172.21.15.119:0/2957519029 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac40b3c80 con 0x7fdac415e760 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac259c640 1 --2- 172.21.15.119:0/2957519029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac415e760 0x7fdac406cdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac408d890 tx=0x7fdab402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe9306ead334d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac1d9b640 1 -- 172.21.15.119:0/2957519029 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4037070 con 0x7fdac415e760 2024-09-12T02:34:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac1d9b640 1 -- 172.21.15.119:0/2957519029 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab4032440 con 0x7fdac415e760 2024-09-12T02:34:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac1d9b640 1 -- 172.21.15.119:0/2957519029 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4032810 con 0x7fdac415e760 2024-09-12T02:34:08.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 -- 172.21.15.119:0/2957519029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac415e760 msgr2=0x7fdac406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2957519029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac415e760 0x7fdac406cdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac408d890 tx=0x7fdab402a230 comp rx=0 tx=0).stop 2024-09-12T02:34:08.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 -- 172.21.15.119:0/2957519029 shutdown_connections 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2957519029 >> v2:172.21.15.153:3300/0 conn(0x7fdac40cfcc0 0x7fdac40d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2957519029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac415e760 0x7fdac406cdd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 -- 172.21.15.119:0/2957519029 >> 172.21.15.119:0/2957519029 conn(0x7fdac408bfc0 msgr2=0x7fdac40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 -- 172.21.15.119:0/2957519029 shutdown_connections 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.318+0000 7fdac89f6640 1 -- 172.21.15.119:0/2957519029 wait complete. 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.320+0000 7fdac89f6640 1 Processor -- start 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.320+0000 7fdac89f6640 1 -- start start 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 0x7fdac40b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 0x7fdac40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40d33e0 con 0x7fdac40cfcc0 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40b38e0 con 0x7fdac415e760 2024-09-12T02:34:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdac40d3560 con 0x7fdac40d4fd0 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33212/0 (socket says 172.21.15.119:33212) 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 -- 172.21.15.119:0/2310583906 learned_addr learned my addr 172.21.15.119:0/2310583906 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdab9d9b640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 0x7fdac40b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac2d9d640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 0x7fdac40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 -- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 msgr2=0x7fdac40b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 0x7fdac40b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 -- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 msgr2=0x7fdac40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 0x7fdac40b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 -- 172.21.15.119:0/2310583906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac40b7520 con 0x7fdac40cfcc0 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdab9d9b640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 0x7fdac40b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac2d9d640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 0x7fdac40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac259c640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000c00 tx=0x7fdab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4041070 con 0x7fdac40cfcc0 2024-09-12T02:34:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab403c870 con 0x7fdac40cfcc0 2024-09-12T02:34:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4037040 con 0x7fdac40cfcc0 2024-09-12T02:34:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac40b7800 con 0x7fdac40cfcc0 2024-09-12T02:34:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.321+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac40b7dc0 con 0x7fdac40cfcc0 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.322+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac40d3890 con 0x7fdac40cfcc0 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.323+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdab4044070 con 0x7fdac40cfcc0 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.323+0000 7fdabb7fe640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 0x7fdaa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.323+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdab40abd60 con 0x7fdac40cfcc0 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.323+0000 7fdab9d9b640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 0x7fdaa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.323+0000 7fdab9d9b640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 0x7fdaa406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdac41f7b10 tx=0x7fdaac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.327+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdac40d2700 con 0x7fdac40cfcc0 2024-09-12T02:34:08.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.527+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdac40b6d20 con 0x7fdac40cfcc0 2024-09-12T02:34:08.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.527+0000 7fdabb7fe640 1 -- 172.21.15.119:0/2310583906 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fdab407a3d0 con 0x7fdac40cfcc0 2024-09-12T02:34:08.529 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:34:08.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 msgr2=0x7fdaa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 0x7fdaa406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdac41f7b10 tx=0x7fdaac009040 comp rx=0 tx=0).stop 2024-09-12T02:34:08.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 msgr2=0x7fdac4159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000c00 tx=0x7fdab40046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 shutdown_connections 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdaa406be30 0x7fdaa406e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdac415e760 0x7fdac40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdac40d4fd0 0x7fdac40b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 --2- 172.21.15.119:0/2310583906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdac40cfcc0 0x7fdac4159ed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 >> 172.21.15.119:0/2310583906 conn(0x7fdac408bfc0 msgr2=0x7fdac40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 shutdown_connections 2024-09-12T02:34:08.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08.529+0000 7fdac89f6640 1 -- 172.21.15.119:0/2310583906 wait complete. 2024-09-12T02:34:08.541 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:34:08.542 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:34:08.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:08.542 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:08.558 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42784sec preferred_lft 42784sec 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-12T02:34:08.559 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:08.560 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:34:08.560 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:08.560 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:08.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:34:08.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-09-12T02:34:08.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-09-12T02:34:08.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:34:08.561 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:08.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:08.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:08.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:08.761 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:34:08.785 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-12T02:34:08.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:08.788 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-12T02:34:08.859 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-12T02:34:08.859 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:34:08.859 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:34:08.859 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:34:08.859 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:34:08.860 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:08.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:09.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:09.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:09.173 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:34:09.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:09.189 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-12T02:34:09.244 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:09.244 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:09.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:09.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T02:34:09.244 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:09.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:09.365 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T02:34:09.365 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:09.365 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T02:34:09.366 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:09.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:09.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:09.496 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:09.496 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:09.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-12T02:34:09.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:34:09.496 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:09.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:09.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:09.573 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T02:34:09.573 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:09.573 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:09.588 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:34:09.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:09.589 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:09.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-12T02:34:09.709 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-09-12T02:34:09.767 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-09-12T02:34:09.768 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:34:09.769 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:09.770 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:09.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:09.771 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-12T02:34:09.823 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:34:09.823 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T02:34:09.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-12T02:34:09.890 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:09.949 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-12T02:34:09.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:2024-09-12T02:34:09.994+0000 7febed9ed480 -1 init, newargv = 0x560d76f28240 newargc=15 2024-09-12T02:34:09.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43131]: starting ceph client 2024-09-12T02:34:10.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43131]: starting fuse 2024-09-12T02:34:10.004 INFO:teuthology.orchestra.run.smithi119.stdout:41 2024-09-12T02:34:10.004 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-12T02:34:10.004 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:34:10.004 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-09-12T02:34:10.005 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.admin")) 2024-09-12T02:34:10.006 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-12T02:34:10.122 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.admin.43131.asok 2024-09-12T02:34:10.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:10.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43131.asok 2024-09-12T02:34:10.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:10.133 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43131.asok status 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "admin", 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-09-12T02:34:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "43131", 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4401, 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4401 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-12T02:34:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1993206270 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1993206270 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4401 192.168.0.1:0/1993206270", 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/1993206270", 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 6, 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 27, 2024-09-12T02:34:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:34:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-09-12T02:34:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-09-12T02:34:10.271 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:34:10.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:10.276 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-09-12T02:34:10.276 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:10.292 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-09-12T02:34:10.292 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:10.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:10.292 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:10.358 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T02:34:10.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:10.466 INFO:teuthology.orchestra.run.smithi119.stdout:# file: . 2024-09-12T02:34:10.466 INFO:teuthology.orchestra.run.smithi119.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T02:34:10.466 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:10.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:10.472 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:10.472 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:10.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:10.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.625+0000 7fcb9155f640 1 Processor -- start 2024-09-12T02:34:10.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.625+0000 7fcb9155f640 1 -- start start 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb9155f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb8c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb9155f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb8c0cdbe0 con 0x7fcb8c15b300 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb9155f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb8c0cd900 con 0x7fcb8c06f700 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb9155f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8c06fb50 con 0x7fcb8c072d30 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb8affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcb8c15b300 0x7fcb8c0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38412/0 (socket says 172.21.15.119:38412) 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb8affd640 1 -- 172.21.15.119:0/3465973708 learned_addr learned my addr 172.21.15.119:0/3465973708 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453088206 0 0) 0x7fcb8c0cdbe0 con 0x7fcb8c15b300 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb74003520 con 0x7fcb8c15b300 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.626+0000 7fcb8a7fc640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb8c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1796878033 0 0) 0x7fcb74003520 con 0x7fcb8c15b300 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 msgr2=0x7fcb8c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb8c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 >> v1:172.21.15.153:6789/0 conn(0x7fcb8c06f700 legacy=0x7fcb8c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c072250 con 0x7fcb8c15b300 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fcb7c0019f0 con 0x7fcb8c15b300 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 >> v1:172.21.15.119:6789/0 conn(0x7fcb8c15b300 legacy=0x7fcb8c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb740039e0 0x7fcb74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb74004d40 0x7fcb740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c06fb50 con 0x7fcb74004d40 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7400baa0 con 0x7fcb740039e0 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7400bca0 con 0x7fcb8c072d30 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb74004d40 0x7fcb740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8affd640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb740039e0 0x7fcb74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8a7fc640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 msgr2=0x7fcb74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c072d30 0x7fcb74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb740039e0 msgr2=0x7fcb74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb740039e0 0x7fcb74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.627+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/3465973708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74003520 con 0x7fcb74004d40 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.628+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb74004d40 0x7fcb740051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001720 tx=0x7fcb74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c0ce60dd5ac839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.628+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84001370 con 0x7fcb74004d40 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.628+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb840052d0 con 0x7fcb74004d40 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.628+0000 7fcb89ffb640 1 -- 172.21.15.119:0/3465973708 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8402abc0 con 0x7fcb74004d40 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 -- 172.21.15.119:0/3465973708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb74004d40 msgr2=0x7fcb740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 --2- 172.21.15.119:0/3465973708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb74004d40 0x7fcb740051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001720 tx=0x7fcb74005830 comp rx=0 tx=0).stop 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/3465973708 reap_dead start 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 -- 172.21.15.119:0/3465973708 shutdown_connections 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 -- 172.21.15.119:0/3465973708 >> 172.21.15.119:0/3465973708 conn(0x7fcb8c067d70 msgr2=0x7fcb8c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 -- 172.21.15.119:0/3465973708 shutdown_connections 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.629+0000 7fcb9155f640 1 -- 172.21.15.119:0/3465973708 wait complete. 2024-09-12T02:34:10.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.630+0000 7fcb9155f640 1 Processor -- start 2024-09-12T02:34:10.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.630+0000 7fcb9155f640 1 -- start start 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb8c0aa450 0x7fcb8c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c1575a0 0x7fcb8c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c0cd5c0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c0728a0 con 0x7fcb8c0aa450 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8c0cffe0 con 0x7fcb8c1575a0 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33234/0 (socket says 172.21.15.119:33234) 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/2857082527 learned_addr learned my addr 172.21.15.119:0/2857082527 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8affd640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb8c0aa450 0x7fcb8c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8a7fc640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c1575a0 0x7fcb8c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c1575a0 msgr2=0x7fcb8c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c1575a0 0x7fcb8c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb8c0aa450 msgr2=0x7fcb8c0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb8c0aa450 0x7fcb8c0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 -- 172.21.15.119:0/2857082527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c1f5cb0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb8b7fe640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402a570 tx=0x7fcb84001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84001370 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8402be50 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84007a30 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.631+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c1f5f90 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.632+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1f6550 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.632+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8c1516a0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.633+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb84043020 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.633+0000 7fcb737fe640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 0x7fcb7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.633+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcb840aa150 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.633+0000 7fcb8affd640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 0x7fcb7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.634+0000 7fcb8affd640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 0x7fcb7806e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001560 tx=0x7fcb7c006040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.638+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb8c1516a0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.817+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb8c06f1c0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.818+0000 7fcb737fe640 1 -- 172.21.15.119:0/2857082527 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fcb840787f0 con 0x7fcb8c15d3b0 2024-09-12T02:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 msgr2=0x7fcb7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 0x7fcb7806e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001560 tx=0x7fcb7c006040 comp rx=0 tx=0).stop 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 msgr2=0x7fcb8c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402a570 tx=0x7fcb84001120 comp rx=0 tx=0).stop 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 shutdown_connections 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcb7806be60 0x7fcb7806e320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb8c15d3b0 0x7fcb8c15d830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb8c1575a0 0x7fcb8c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 --2- 172.21.15.119:0/2857082527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb8c0aa450 0x7fcb8c0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 >> 172.21.15.119:0/2857082527 conn(0x7fcb8c067d70 msgr2=0x7fcb8c1595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:10.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 shutdown_connections 2024-09-12T02:34:10.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.820+0000 7fcb9155f640 1 -- 172.21.15.119:0/2857082527 wait complete. 2024-09-12T02:34:10.832 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:10.832 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:10.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.986+0000 7f87f5fe4640 1 Processor -- start 2024-09-12T02:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.986+0000 7f87f5fe4640 1 -- start start 2024-09-12T02:34:10.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87f5fe4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87f00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87f5fe4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f006e040 con 0x7f87f006dbd0 2024-09-12T02:34:10.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87f5fe4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f00d0780 con 0x7f87f009b690 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87f5fe4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f87f015eb20 con 0x7f87f015e740 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87effff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f87f006dbd0 0x7f87f0070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38424/0 (socket says 172.21.15.119:38424) 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87effff640 1 -- 172.21.15.119:0/3018349425 learned_addr learned my addr 172.21.15.119:0/3018349425 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759791085 0 0) 0x7f87f006e040 con 0x7f87f006dbd0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87ef7fe640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87f00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.987+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d8003520 con 0x7f87f006dbd0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3285300500 0 0) 0x7f87d8003520 con 0x7f87f006dbd0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 msgr2=0x7f87f00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87f00d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 >> v1:172.21.15.153:6789/0 conn(0x7f87f009b690 legacy=0x7f87f006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f00d0a60 con 0x7f87f006dbd0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f87e80019f0 con 0x7f87f006dbd0 2024-09-12T02:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 >> v1:172.21.15.119:6789/0 conn(0x7f87f006dbd0 legacy=0x7f87f0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87d8003f60 0x7f87d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f015eb20 con 0x7f87d8004d40 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87d800bb30 con 0x7f87d8003f60 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f87d800bd30 con 0x7f87f015e740 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87ef7fe640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87eeffd640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87d8003f60 0x7f87d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 -- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 msgr2=0x7f87d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f015e740 0x7f87d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 -- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87d8003f60 msgr2=0x7f87d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:10.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87d8003f60 0x7f87d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.988+0000 7f87effff640 1 -- 172.21.15.119:0/3018349425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d8003520 con 0x7f87d8004d40 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87effff640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87d80051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87e800a850 tx=0x7f87d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c8de86cbf1cc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800a4a0 con 0x7f87d8004d40 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e802f070 con 0x7f87d8004d40 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87ee7fc640 1 -- 172.21.15.119:0/3018349425 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e802bd20 con 0x7f87d8004d40 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87f5fe4640 1 -- 172.21.15.119:0/3018349425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 msgr2=0x7f87d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/3018349425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87d80051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87e800a850 tx=0x7f87d8005830 comp rx=0 tx=0).stop 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87effff640 1 -- 172.21.15.119:0/3018349425 reap_dead start 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87f5fe4640 1 -- 172.21.15.119:0/3018349425 shutdown_connections 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87f5fe4640 1 -- 172.21.15.119:0/3018349425 >> 172.21.15.119:0/3018349425 conn(0x7f87f00d23a0 msgr2=0x7f87f00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.989+0000 7f87f5fe4640 1 -- 172.21.15.119:0/3018349425 shutdown_connections 2024-09-12T02:34:10.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.990+0000 7f87f5fe4640 1 -- 172.21.15.119:0/3018349425 wait complete. 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.991+0000 7f87f5fe4640 1 Processor -- start 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.991+0000 7f87f5fe4640 1 -- start start 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f00c8be0 0x7f87f00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87f0153c70 0x7f87f015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f009ba90 con 0x7f87d8004d40 2024-09-12T02:34:10.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87f00d1020 con 0x7f87f0153c70 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f87f00d1540 con 0x7f87f00c8be0 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33254/0 (socket says 172.21.15.119:33254) 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 -- 172.21.15.119:0/222388564 learned_addr learned my addr 172.21.15.119:0/222388564 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87eeffd640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f00c8be0 0x7f87f00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87effff640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87f0153c70 0x7f87f015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 -- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f00c8be0 msgr2=0x7f87f00ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f00c8be0 0x7f87f00ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 -- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87f0153c70 msgr2=0x7f87f015c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87f0153c70 0x7f87f015c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 -- 172.21.15.119:0/222388564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f00caef0 con 0x7f87d8004d40 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87ef7fe640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e00119a0 tx=0x7f87e0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000faf0 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e000fc90 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0014440 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f00c7b40 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.992+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f00c8100 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.993+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f00d1900 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.994+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87e0012040 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.994+0000 7f87d7fff640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 0x7f87dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.994+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f87e008b7d0 con 0x7f87d8004d40 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.994+0000 7f87eeffd640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 0x7f87dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.995+0000 7f87eeffd640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 0x7f87dc06e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87f015dd10 tx=0x7f87e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:11.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:10.999+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87e0019030 con 0x7f87d8004d40 2024-09-12T02:34:11.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.178+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87f00d1cb0 con 0x7f87d8004d40 2024-09-12T02:34:11.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.179+0000 7f87d7fff640 1 -- 172.21.15.119:0/222388564 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f87e0059db0 con 0x7f87d8004d40 2024-09-12T02:34:11.180 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 msgr2=0x7f87dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 0x7f87dc06e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87f015dd10 tx=0x7f87e4009040 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 msgr2=0x7f87f00c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e00119a0 tx=0x7f87e0011e60 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 shutdown_connections 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f87dc06be60 0x7f87dc06e320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87f0153c70 0x7f87f015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87f00c8be0 0x7f87f00ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 --2- 172.21.15.119:0/222388564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d8004d40 0x7f87f00c7440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 >> 172.21.15.119:0/222388564 conn(0x7f87f00d23a0 msgr2=0x7f87f00b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 shutdown_connections 2024-09-12T02:34:11.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:11.181+0000 7f87f5fe4640 1 -- 172.21.15.119:0/222388564 wait complete. 2024-09-12T02:34:11.193 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-09-12T02:34:11.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:11.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:34:11.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43131]: fuse finished with error 0 and tester_r 0 2024-09-12T02:34:11.218 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:17.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:34:17.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:17.320 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T02:34:17.354 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.504+0000 7f626f90a640 1 Processor -- start 2024-09-12T02:34:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.504+0000 7f626f90a640 1 -- start start 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626f90a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f6268165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626f90a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62680cdbe0 con 0x7f6268072d30 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626f90a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62680cd900 con 0x7f626815b300 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626f90a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62680728a0 con 0x7f626806f8d0 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626cea5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6268072d30 0x7f626806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38438/0 (socket says 172.21.15.119:38438) 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.505+0000 7f626cea5640 1 -- 172.21.15.119:0/4055952907 learned_addr learned my addr 172.21.15.119:0/4055952907 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f6268165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58789911 0 0) 0x7f62680cdbe0 con 0x7f6268072d30 2024-09-12T02:34:17.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6254003520 con 0x7f6268072d30 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3020772270 0 0) 0x7f6254003520 con 0x7f6268072d30 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 msgr2=0x7f6268165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f6268165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 >> v1:172.21.15.153:6789/0 conn(0x7f626815b300 legacy=0x7f62680cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6268072250 con 0x7f6268072d30 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f6258001670 con 0x7f6268072d30 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 >> v1:172.21.15.119:6789/0 conn(0x7f6268072d30 legacy=0x7f626806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f62540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254003f60 0x7f6254004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6254004d40 0x7f62540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62680728a0 con 0x7f6254004d40 2024-09-12T02:34:17.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f625400bb50 con 0x7f6254003f60 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f625400bd50 con 0x7f626806f8d0 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626d6a6640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f62540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6254004d40 0x7f62540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626cea5640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254003f60 0x7f6254004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 -- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 msgr2=0x7f62540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f626806f8d0 0x7f62540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 -- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254003f60 msgr2=0x7f6254004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254003f60 0x7f6254004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.506+0000 7f626dea7640 1 -- 172.21.15.119:0/4055952907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254003520 con 0x7f6254004d40 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.507+0000 7f626dea7640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6254004d40 0x7f62540051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6260009f90 tx=0x7f6254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ab28cb795a9743 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.507+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260009c10 con 0x7f6254004d40 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.507+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260036070 con 0x7f6254004d40 2024-09-12T02:34:17.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.507+0000 7f625ffff640 1 -- 172.21.15.119:0/4055952907 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260031810 con 0x7f6254004d40 2024-09-12T02:34:17.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 -- 172.21.15.119:0/4055952907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6254004d40 msgr2=0x7f62540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 --2- 172.21.15.119:0/4055952907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6254004d40 0x7f62540051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6260009f90 tx=0x7f6254005830 comp rx=0 tx=0).stop 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626dea7640 1 -- 172.21.15.119:0/4055952907 reap_dead start 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 -- 172.21.15.119:0/4055952907 shutdown_connections 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 -- 172.21.15.119:0/4055952907 >> 172.21.15.119:0/4055952907 conn(0x7f6268067d70 msgr2=0x7f626806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 -- 172.21.15.119:0/4055952907 shutdown_connections 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.508+0000 7f626f90a640 1 -- 172.21.15.119:0/4055952907 wait complete. 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.509+0000 7f626f90a640 1 Processor -- start 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.509+0000 7f626f90a640 1 -- start start 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 0x7f62680a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62680aa1d0 0x7f6268153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62680cffe0 con 0x7f6268153f90 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62680cd5c0 con 0x7f6254004d40 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626f90a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62680d0160 con 0x7f62680aa1d0 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33266/0 (socket says 172.21.15.119:33266) 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 -- 172.21.15.119:0/3843905744 learned_addr learned my addr 172.21.15.119:0/3843905744 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626cea5640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62680aa1d0 0x7f6268153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626d6a6640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 0x7f62680a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 -- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62680aa1d0 msgr2=0x7f6268153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62680aa1d0 0x7f6268153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 -- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 msgr2=0x7f62680a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 0x7f62680a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 -- 172.21.15.119:0/3843905744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6268154ce0 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626d6a6640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 0x7f62680a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.510+0000 7f626dea7640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f626002aeb0 tx=0x7f6260009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.511+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260009c10 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.511+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260040030 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.511+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62681f58b0 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.511+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260045860 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.511+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62681f5e70 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.512+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62680aa5b0 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.512+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6260005d10 con 0x7f6268153f90 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.513+0000 7f625dffb640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.513+0000 7f626d6a6640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.513+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f62600ac470 con 0x7f6268153f90 2024-09-12T02:34:17.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.513+0000 7f626d6a6640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 0x7f624c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62681f67a0 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.518+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f626004a020 con 0x7f6268153f90 2024-09-12T02:34:17.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.685+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f626806f1c0 con 0x7f6268153f90 2024-09-12T02:34:17.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.687+0000 7f625dffb640 1 -- 172.21.15.119:0/3843905744 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f626002e050 con 0x7f6268153f90 2024-09-12T02:34:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:17.688 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 msgr2=0x7f624c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 0x7f624c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62681f67a0 tx=0x7f6264009040 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 msgr2=0x7f626806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f626002aeb0 tx=0x7f6260009750 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 shutdown_connections 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6268153f90 0x7f626806e0b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62680aa1d0 0x7f6268153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 --2- 172.21.15.119:0/3843905744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6254004d40 0x7f62680a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 >> 172.21.15.119:0/3843905744 conn(0x7f6268067d70 msgr2=0x7f626815c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 shutdown_connections 2024-09-12T02:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.689+0000 7f626f90a640 1 -- 172.21.15.119:0/3843905744 wait complete. 2024-09-12T02:34:17.701 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:17.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.799+0000 7f1988718640 1 Processor -- start 2024-09-12T02:34:17.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.799+0000 7f1988718640 1 -- start start 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1988718640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f198015e740 0x7f19800d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1988718640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f198006dbd0 0x7f198006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1988718640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19800d0780 con 0x7f198009b690 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1988718640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f198015eb20 con 0x7f198015e740 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1988718640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f198006d260 con 0x7f198006dbd0 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19864b4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f198015e740 0x7f19800d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1985cb3640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f198009b690 0x7f198006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38442/0 (socket says 172.21.15.119:38442) 2024-09-12T02:34:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19864b4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f198015e740 0x7f19800d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33268/0 (socket says 172.21.15.119:33268) 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1985cb3640 1 -- 172.21.15.119:0/1370668745 learned_addr learned my addr 172.21.15.119:0/1370668745 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f1986cb5640 1 --2- 172.21.15.119:0/1370668745 >> v2:172.21.15.153:3300/0 conn(0x7f198006dbd0 0x7f198006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19864b4640 1 -- 172.21.15.119:0/1370668745 >> v2:172.21.15.153:3300/0 conn(0x7f198006dbd0 msgr2=0x7f198006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19864b4640 1 --2- 172.21.15.119:0/1370668745 >> v2:172.21.15.153:3300/0 conn(0x7f198006dbd0 0x7f198006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19864b4640 1 -- 172.21.15.119:0/1370668745 >> v1:172.21.15.119:6789/0 conn(0x7f198009b690 legacy=0x7f198006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.801+0000 7f19864b4640 1 -- 172.21.15.119:0/1370668745 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19800d0a60 con 0x7f198015e740 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.800+0000 7f19854b2640 1 -- 172.21.15.119:0/1370668745 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654948708 0 0) 0x7f19800d0780 con 0x7f198009b690 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.801+0000 7f19864b4640 1 --2- 172.21.15.119:0/1370668745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f19800d1540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f198006cba0 tx=0x7f197c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5097d5f27e6048dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.801+0000 7f19854b2640 1 -- 172.21.15.119:0/1370668745 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c037070 con 0x7f198015e740 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.801+0000 7f19854b2640 1 -- 172.21.15.119:0/1370668745 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c032440 con 0x7f198015e740 2024-09-12T02:34:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.801+0000 7f19854b2640 1 -- 172.21.15.119:0/1370668745 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c032810 con 0x7f198015e740 2024-09-12T02:34:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 -- 172.21.15.119:0/1370668745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 msgr2=0x7f19800d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 --2- 172.21.15.119:0/1370668745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f19800d1540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f198006cba0 tx=0x7f197c02a230 comp rx=0 tx=0).stop 2024-09-12T02:34:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 -- 172.21.15.119:0/1370668745 shutdown_connections 2024-09-12T02:34:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 --2- 172.21.15.119:0/1370668745 >> v2:172.21.15.153:3300/0 conn(0x7f198006dbd0 0x7f198006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 --2- 172.21.15.119:0/1370668745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f19800d1540 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 -- 172.21.15.119:0/1370668745 >> 172.21.15.119:0/1370668745 conn(0x7f19800d23a0 msgr2=0x7f19800d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 -- 172.21.15.119:0/1370668745 shutdown_connections 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.802+0000 7f1988718640 1 -- 172.21.15.119:0/1370668745 wait complete. 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.803+0000 7f1988718640 1 Processor -- start 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.803+0000 7f1988718640 1 -- start start 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f198006dbd0 0x7f19800b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198009b690 0x7f198015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f198009bac0 con 0x7f198015e740 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19800d1020 con 0x7f198009b690 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1988718640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f198006dfe0 con 0x7f198006dbd0 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33278/0 (socket says 172.21.15.119:33278) 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 -- 172.21.15.119:0/3627843925 learned_addr learned my addr 172.21.15.119:0/3627843925 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f19864b4640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f198006dbd0 0x7f19800b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1985cb3640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198009b690 0x7f198015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 -- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f198006dbd0 msgr2=0x7f19800b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f198006dbd0 0x7f19800b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 -- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198009b690 msgr2=0x7f198015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198009b690 0x7f198015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 -- 172.21.15.119:0/3627843925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198015c530 con 0x7f198015e740 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.804+0000 7f1986cb5640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f197800cc30 tx=0x7f197800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.805+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197800ce40 con 0x7f198015e740 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.805+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1978003990 con 0x7f198015e740 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.805+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198015c7d0 con 0x7f198015e740 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.805+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978003d40 con 0x7f198015e740 2024-09-12T02:34:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.805+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19800b73d0 con 0x7f198015e740 2024-09-12T02:34:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.806+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19800d0780 con 0x7f198015e740 2024-09-12T02:34:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.806+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1978003fa0 con 0x7f198015e740 2024-09-12T02:34:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.807+0000 7f1976ffd640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 0x7f196406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.807+0000 7f19864b4640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 0x7f196406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.807+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f197808b670 con 0x7f198015e740 2024-09-12T02:34:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.807+0000 7f19864b4640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 0x7f196406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f197c034000 tx=0x7f197c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:17.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.811+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1978014030 con 0x7f198015e740 2024-09-12T02:34:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.978+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19800d1cb0 con 0x7f198015e740 2024-09-12T02:34:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.979+0000 7f1976ffd640 1 -- 172.21.15.119:0/3627843925 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f1978059c50 con 0x7f198015e740 2024-09-12T02:34:17.980 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:17.980 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 msgr2=0x7f196406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 0x7f196406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f197c034000 tx=0x7f197c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 msgr2=0x7f198015d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f197800cc30 tx=0x7f197800a5c0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 shutdown_connections 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f196406be30 0x7f196406e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f198015e740 0x7f198015d450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.981+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198009b690 0x7f198015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.982+0000 7f1988718640 1 --2- 172.21.15.119:0/3627843925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f198006dbd0 0x7f19800b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.982+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 >> 172.21.15.119:0/3627843925 conn(0x7f19800d23a0 msgr2=0x7f19800b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.982+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 shutdown_connections 2024-09-12T02:34:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:17.982+0000 7f1988718640 1 -- 172.21.15.119:0/3627843925 wait complete. 2024-09-12T02:34:17.994 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:34:18.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.095+0000 7f68444e4640 1 Processor -- start 2024-09-12T02:34:18.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.095+0000 7f68444e4640 1 -- start start 2024-09-12T02:34:18.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f68444e4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f683c161a20 0x7f683c0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f68444e4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f683c0cf330 0x7f683c06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f68444e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683c0d1830 con 0x7f683c0d1420 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f68444e4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f683c0cf760 con 0x7f683c161a20 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f68444e4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f683c161e00 con 0x7f683c0cf330 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842280640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f683c161a20 0x7f683c0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6841a7f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f683c0d1420 0x7f683c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49176/0 (socket says 172.21.15.119:49176) 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6841a7f640 1 -- 172.21.15.119:0/4076348608 learned_addr learned my addr 172.21.15.119:0/4076348608 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842a81640 1 --2- 172.21.15.119:0/4076348608 >> v2:172.21.15.153:3300/0 conn(0x7f683c0cf330 0x7f683c06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842280640 1 -- 172.21.15.119:0/4076348608 >> v2:172.21.15.153:3300/0 conn(0x7f683c0cf330 msgr2=0x7f683c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842280640 1 --2- 172.21.15.119:0/4076348608 >> v2:172.21.15.153:3300/0 conn(0x7f683c0cf330 0x7f683c06d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842280640 1 -- 172.21.15.119:0/4076348608 >> v1:172.21.15.119:6789/0 conn(0x7f683c0d1420 legacy=0x7f683c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f684127e640 1 -- 172.21.15.119:0/4076348608 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415615641 0 0) 0x7f682c001110 con 0x7f683c0d1420 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.096+0000 7f6842280640 1 -- 172.21.15.119:0/4076348608 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c0cf980 con 0x7f683c161a20 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f6842280640 1 --2- 172.21.15.119:0/4076348608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c161a20 0x7f683c0d0ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f683c0d4410 tx=0x7f683802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5241051d0d0a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f684127e640 1 -- 172.21.15.119:0/4076348608 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838037070 con 0x7f683c161a20 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f684127e640 1 -- 172.21.15.119:0/4076348608 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6838032440 con 0x7f683c161a20 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f684127e640 1 -- 172.21.15.119:0/4076348608 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838032810 con 0x7f683c161a20 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f68444e4640 1 -- 172.21.15.119:0/4076348608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c161a20 msgr2=0x7f683c0d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.097+0000 7f68444e4640 1 --2- 172.21.15.119:0/4076348608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c161a20 0x7f683c0d0ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f683c0d4410 tx=0x7f683802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 -- 172.21.15.119:0/4076348608 shutdown_connections 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 --2- 172.21.15.119:0/4076348608 >> v2:172.21.15.153:3300/0 conn(0x7f683c0cf330 0x7f683c06d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 --2- 172.21.15.119:0/4076348608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c161a20 0x7f683c0d0ee0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 -- 172.21.15.119:0/4076348608 >> 172.21.15.119:0/4076348608 conn(0x7f683c09d850 msgr2=0x7f683c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 -- 172.21.15.119:0/4076348608 shutdown_connections 2024-09-12T02:34:18.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.098+0000 7f68444e4640 1 -- 172.21.15.119:0/4076348608 wait complete. 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.099+0000 7f68444e4640 1 Processor -- start 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.099+0000 7f68444e4640 1 -- start start 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.099+0000 7f68444e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f683c0cf330 0x7f683c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c161a20 0x7f683c0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f683c0cff00 con 0x7f683c0d1420 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f683c06d050 con 0x7f683c161a20 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f683c06d2f0 con 0x7f683c0cf330 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56612/0 (socket says 172.21.15.119:56612) 2024-09-12T02:34:18.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 -- 172.21.15.119:0/558026503 learned_addr learned my addr 172.21.15.119:0/558026503 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6842280640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f683c0cf330 0x7f683c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6842a81640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c161a20 0x7f683c0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 -- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f683c0cf330 msgr2=0x7f683c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f683c0cf330 0x7f683c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 -- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c161a20 msgr2=0x7f683c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c161a20 0x7f683c0cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 -- 172.21.15.119:0/558026503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c0b4d00 con 0x7f683c0d1420 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6841a7f640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c780 tx=0x7f682c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c018070 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c0072d0 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0047e0 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c0b6800 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.100+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c0b6dc0 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.101+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c0b1040 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.102+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f682c01b070 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.102+0000 7f6832ffd640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.102+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f682c08a330 con 0x7f683c0d1420 2024-09-12T02:34:18.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.102+0000 7f6842280640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.103+0000 7f6842280640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.106+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f683c0d1830 con 0x7f683c0d1420 2024-09-12T02:34:18.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:18.307+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f683c06e3b0 con 0x7f683c0d1420 2024-09-12T02:34:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.252+0000 7f6832ffd640 1 -- 172.21.15.119:0/558026503 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f682c0583e0 con 0x7f683c0d1420 2024-09-12T02:34:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 msgr2=0x7f682006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 msgr2=0x7f683c0c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c780 tx=0x7f682c00cc40 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 shutdown_connections 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c161a20 0x7f683c0cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f683c0d1420 0x7f683c0c8000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 --2- 172.21.15.119:0/558026503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f683c0cf330 0x7f683c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 >> 172.21.15.119:0/558026503 conn(0x7f683c09d850 msgr2=0x7f683c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 shutdown_connections 2024-09-12T02:34:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.255+0000 7f68444e4640 1 -- 172.21.15.119:0/558026503 wait complete. 2024-09-12T02:34:19.268 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-12T02:34:19.268 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:34:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.373+0000 7f2038731640 1 Processor -- start 2024-09-12T02:34:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.373+0000 7f2038731640 1 -- start start 2024-09-12T02:34:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2038731640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f203015f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2038731640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f203015f850 0x7f203006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2038731640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20300d0950 con 0x7f203009aa30 2024-09-12T02:34:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2038731640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f20300d17e0 con 0x7f203015f850 2024-09-12T02:34:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2038731640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f20300d0bd0 con 0x7f20300d0510 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20364cd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f203009aa30 0x7f203009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49180/0 (socket says 172.21.15.119:49180) 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20364cd640 1 -- 172.21.15.119:0/943855497 learned_addr learned my addr 172.21.15.119:0/943855497 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2036cce640 1 --2- 172.21.15.119:0/943855497 >> v2:172.21.15.153:3300/0 conn(0x7f203015f850 0x7f203006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f2035ccc640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f203015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140761957 0 0) 0x7f202c001110 con 0x7f203009aa30 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f201c003520 con 0x7f203009aa30 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450819482 0 0) 0x7f201c003520 con 0x7f203009aa30 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 msgr2=0x7f203015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f203015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 >> v2:172.21.15.153:3300/0 conn(0x7f203015f850 msgr2=0x7f203006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 --2- 172.21.15.119:0/943855497 >> v2:172.21.15.153:3300/0 conn(0x7f203015f850 0x7f203006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20300d0eb0 con 0x7f203009aa30 2024-09-12T02:34:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f202c001840 con 0x7f203009aa30 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 >> v1:172.21.15.119:6789/0 conn(0x7f203009aa30 legacy=0x7f203009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f201c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c004d40 0x7f201c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20300d17e0 con 0x7f201c0039b0 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20300d0bd0 con 0x7f201c004d40 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.374+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f201c00b9c0 con 0x7f20300d0510 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f2035ccc640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f201c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f2036cce640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c004d40 0x7f201c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 -- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 msgr2=0x7f201c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20300d0510 0x7f201c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 -- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c004d40 msgr2=0x7f201c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c004d40 0x7f201c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f20364cd640 1 -- 172.21.15.119:0/943855497 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c003520 con 0x7f201c0039b0 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.375+0000 7f2036cce640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c004d40 0x7f201c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f20364cd640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c4c0 tx=0x7f201c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb4dc692d12769e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c00c0e0 con 0x7f201c0039b0 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c034070 con 0x7f201c0039b0 2024-09-12T02:34:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f20354cb640 1 -- 172.21.15.119:0/943855497 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c005d10 con 0x7f201c0039b0 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 -- 172.21.15.119:0/943855497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 msgr2=0x7f201c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 --2- 172.21.15.119:0/943855497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c4c0 tx=0x7f201c005830 comp rx=0 tx=0).stop 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2036cce640 1 -- 172.21.15.119:0/943855497 reap_dead start 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 -- 172.21.15.119:0/943855497 shutdown_connections 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 -- 172.21.15.119:0/943855497 >> 172.21.15.119:0/943855497 conn(0x7f20300d2380 msgr2=0x7f20300d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 -- 172.21.15.119:0/943855497 shutdown_connections 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.376+0000 7f2038731640 1 -- 172.21.15.119:0/943855497 wait complete. 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.377+0000 7f2038731640 1 Processor -- start 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.377+0000 7f2038731640 1 -- start start 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 0x7f203009e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f203009cf20 0x7f2030162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f203015f310 con 0x7f201c0039b0 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20300d1470 con 0x7f20301599a0 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f2038731640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f203015f490 con 0x7f203009cf20 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f20364cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f20364cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56630/0 (socket says 172.21.15.119:56630) 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.378+0000 7f20364cd640 1 -- 172.21.15.119:0/3493957976 learned_addr learned my addr 172.21.15.119:0/3493957976 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2035ccc640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 0x7f203009e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2036cce640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f203009cf20 0x7f2030162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 -- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f203009cf20 msgr2=0x7f2030162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f203009cf20 0x7f2030162540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 -- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 msgr2=0x7f203009e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 0x7f203009e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 -- 172.21.15.119:0/3493957976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203009e920 con 0x7f201c0039b0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2035ccc640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 0x7f203009e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f20364cd640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f202c031040 tx=0x7f202c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c007270 con 0x7f201c0039b0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c007410 con 0x7f201c0039b0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203009c440 con 0x7f201c0039b0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0077e0 con 0x7f201c0039b0 2024-09-12T02:34:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.379+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203009e560 con 0x7f201c0039b0 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.380+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203009ae10 con 0x7f201c0039b0 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.380+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f202c02f480 con 0x7f201c0039b0 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.381+0000 7f2026ffd640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 0x7f201406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.381+0000 7f2035ccc640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 0x7f201406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.381+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f202c0ab890 con 0x7f201c0039b0 2024-09-12T02:34:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.381+0000 7f2035ccc640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 0x7f201406e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20300704f0 tx=0x7f2020008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.385+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f202c049030 con 0x7f201c0039b0 2024-09-12T02:34:19.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:19.585+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f20300b80c0 con 0x7f201c0039b0 2024-09-12T02:34:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.253+0000 7f2026ffd640 1 -- 172.21.15.119:0/3493957976 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f202c040070 con 0x7f201c0039b0 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 msgr2=0x7f201406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 0x7f201406e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20300704f0 tx=0x7f2020008040 comp rx=0 tx=0).stop 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 msgr2=0x7f203014f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f202c031040 tx=0x7f202c000fe0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 shutdown_connections 2024-09-12T02:34:20.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f201406be60 0x7f201406e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f203009cf20 0x7f2030162540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20301599a0 0x7f203009e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 --2- 172.21.15.119:0/3493957976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201c0039b0 0x7f203014f980 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 >> 172.21.15.119:0/3493957976 conn(0x7f20300d2380 msgr2=0x7f203015a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 shutdown_connections 2024-09-12T02:34:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.256+0000 7f2038731640 1 -- 172.21.15.119:0/3493957976 wait complete. 2024-09-12T02:34:20.268 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:34:20.268 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.367+0000 7f187b352640 1 Processor -- start 2024-09-12T02:34:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.367+0000 7f187b352640 1 -- start start 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f187b352640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18740d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f187b352640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187406e040 con 0x7f187406dbd0 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f187b352640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18740d0780 con 0x7f187409b690 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f187b352640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f187415eb20 con 0x7f187415e740 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f18798ef640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f187406dbd0 0x7f1874070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49184/0 (socket says 172.21.15.119:49184) 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f18798ef640 1 -- 172.21.15.119:0/319824033 learned_addr learned my addr 172.21.15.119:0/319824033 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:20.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f18790ee640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18740d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776235837 0 0) 0x7f187406e040 con 0x7f187406dbd0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1860003520 con 0x7f187406dbd0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2956482693 0 0) 0x7f1860003520 con 0x7f187406dbd0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 msgr2=0x7f18740d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18740d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 >> v1:172.21.15.153:6789/0 conn(0x7f187409b690 legacy=0x7f187406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18740d0a60 con 0x7f187406dbd0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f186c0019f0 con 0x7f187406dbd0 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f18790ee640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18740d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 >> v1:172.21.15.119:6789/0 conn(0x7f187406dbd0 legacy=0x7f1874070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1860003f20 0x7f1860004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860004d40 0x7f18600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f187415eb20 con 0x7f1860003f20 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f186000ba20 con 0x7f1860004d40 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.368+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f186000bc20 con 0x7f187415e740 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1860003f20 0x7f1860004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18790ee640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18798ef640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860004d40 0x7f18600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 -- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 msgr2=0x7f18600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f187415e740 0x7f18600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 -- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860004d40 msgr2=0x7f18600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860004d40 0x7f18600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 -- 172.21.15.119:0/319824033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1860003520 con 0x7f1860003f20 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.369+0000 7f18788ed640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1860003f20 0x7f1860004800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1870001830 tx=0x7f1860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567b4e0e1897195a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870037070 con 0x7f1860003f20 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187002ab00 con 0x7f1860003f20 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f1867fff640 1 -- 172.21.15.119:0/319824033 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870001430 con 0x7f1860003f20 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 -- 172.21.15.119:0/319824033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1860003f20 msgr2=0x7f1860004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 --2- 172.21.15.119:0/319824033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1860003f20 0x7f1860004800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1870001830 tx=0x7f1860005830 comp rx=0 tx=0).stop 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f18798ef640 1 -- 172.21.15.119:0/319824033 reap_dead start 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 -- 172.21.15.119:0/319824033 shutdown_connections 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 -- 172.21.15.119:0/319824033 >> 172.21.15.119:0/319824033 conn(0x7f18740d23a0 msgr2=0x7f18740d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 -- 172.21.15.119:0/319824033 shutdown_connections 2024-09-12T02:34:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.370+0000 7f187b352640 1 -- 172.21.15.119:0/319824033 wait complete. 2024-09-12T02:34:20.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.371+0000 7f187b352640 1 Processor -- start 2024-09-12T02:34:20.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.371+0000 7f187b352640 1 -- start start 2024-09-12T02:34:20.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860003f20 0x7f18741f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18741e7f70 0x7f18741e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f187409ba90 con 0x7f18740b05f0 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18740d1020 con 0x7f1860003f20 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f187b352640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f18740d1540 con 0x7f18741e7f70 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f18798ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f18798ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56658/0 (socket says 172.21.15.119:56658) 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f18798ef640 1 -- 172.21.15.119:0/3651220505 learned_addr learned my addr 172.21.15.119:0/3651220505 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f18788ed640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18741e7f70 0x7f18741e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.372+0000 7f18790ee640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860003f20 0x7f18741f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 -- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18741e7f70 msgr2=0x7f18741e83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18741e7f70 0x7f18741e83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 -- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860003f20 msgr2=0x7f18741f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860003f20 0x7f18741f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 -- 172.21.15.119:0/3651220505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18741e8a30 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f18798ef640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1874073300 tx=0x7f186c00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c00ac50 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c018070 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18741e8d10 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c0133f0 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.373+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18740b56e0 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.374+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18740b58e0 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.375+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f186c013590 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.375+0000 7f1865ffb640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 0x7f185806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.375+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f186c08b660 con 0x7f18740b05f0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.375+0000 7f18790ee640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 0x7f185806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.375+0000 7f18790ee640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 0x7f185806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1868009bd0 tx=0x7f1868009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.379+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18740b58e0 con 0x7f18740b05f0 2024-09-12T02:34:20.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.576+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18740b51f0 con 0x7f18740b05f0 2024-09-12T02:34:20.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.577+0000 7f1865ffb640 1 -- 172.21.15.119:0/3651220505 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f186c059cd0 con 0x7f18740b05f0 2024-09-12T02:34:20.578 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:20.578 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:20.578 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 msgr2=0x7f185806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 0x7f185806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1868009bd0 tx=0x7f1868009190 comp rx=0 tx=0).stop 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 msgr2=0x7f18740b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1874073300 tx=0x7f186c00a750 comp rx=0 tx=0).stop 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 shutdown_connections 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f185806be30 0x7f185806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18740b05f0 0x7f18740b0a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18741e7f70 0x7f18741e83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 --2- 172.21.15.119:0/3651220505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1860003f20 0x7f18741f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 >> 172.21.15.119:0/3651220505 conn(0x7f18740d23a0 msgr2=0x7f18740ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 shutdown_connections 2024-09-12T02:34:20.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.579+0000 7f187b352640 1 -- 172.21.15.119:0/3651220505 wait complete. 2024-09-12T02:34:20.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:20.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.688+0000 7f0eaedf8640 1 Processor -- start 2024-09-12T02:34:20.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 -- start start 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea809aa30 0x7f0ea80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ea80b3760 0x7f0ea809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea809b350 con 0x7f0ea806cd20 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80d0670 con 0x7f0ea80b3760 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0eaedf8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea80b2790 con 0x7f0ea809aa30 2024-09-12T02:34:20.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0ea7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ea80b3760 0x7f0ea809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0ea7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ea80b3760 0x7f0ea809ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56660/0 (socket says 172.21.15.119:56660) 2024-09-12T02:34:20.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.689+0000 7f0ea7fff640 1 -- 172.21.15.119:0/3001055606 learned_addr learned my addr 172.21.15.119:0/3001055606 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:20.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0eacb94640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea809aa30 0x7f0ea80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0ea7fff640 1 -- 172.21.15.119:0/3001055606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea809aa30 msgr2=0x7f0ea80b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0ea7fff640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea809aa30 0x7f0ea80b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0ea7fff640 1 -- 172.21.15.119:0/3001055606 >> v1:172.21.15.153:6789/0 conn(0x7f0ea806cd20 legacy=0x7f0ea80d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0ea7fff640 1 -- 172.21.15.119:0/3001055606 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80b2a70 con 0x7f0ea80b3760 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.690+0000 7f0ea7fff640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea809ae10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009e50 tx=0x7f0e9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5497966285c73d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0ea77fe640 1 -- 172.21.15.119:0/3001055606 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98036070 con 0x7f0ea80b3760 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0ea77fe640 1 -- 172.21.15.119:0/3001055606 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e98031600 con 0x7f0ea80b3760 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0ea77fe640 1 -- 172.21.15.119:0/3001055606 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980319d0 con 0x7f0ea80b3760 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 -- 172.21.15.119:0/3001055606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 msgr2=0x7f0ea809ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea809ae10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009e50 tx=0x7f0e9802a680 comp rx=0 tx=0).stop 2024-09-12T02:34:20.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 -- 172.21.15.119:0/3001055606 shutdown_connections 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea809ae10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/3001055606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea809aa30 0x7f0ea80b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 -- 172.21.15.119:0/3001055606 >> 172.21.15.119:0/3001055606 conn(0x7f0ea80d23a0 msgr2=0x7f0ea80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 -- 172.21.15.119:0/3001055606 shutdown_connections 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.691+0000 7f0eaedf8640 1 -- 172.21.15.119:0/3001055606 wait complete. 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.692+0000 7f0eaedf8640 1 Processor -- start 2024-09-12T02:34:20.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.692+0000 7f0eaedf8640 1 -- start start 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea806cd20 0x7f0ea815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea809aa30 0x7f0ea80b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea815fca0 con 0x7f0ea80b3760 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80d08a0 con 0x7f0ea809aa30 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.693+0000 7f0eaedf8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea815fe20 con 0x7f0ea806cd20 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56662/0 (socket says 172.21.15.119:56662) 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 -- 172.21.15.119:0/1209481605 learned_addr learned my addr 172.21.15.119:0/1209481605 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0eacb94640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea806cd20 0x7f0ea815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ea7fff640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea809aa30 0x7f0ea80b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 -- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea806cd20 msgr2=0x7f0ea815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea806cd20 0x7f0ea815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 -- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea809aa30 msgr2=0x7f0ea80b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea809aa30 0x7f0ea80b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 -- 172.21.15.119:0/1209481605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80cb3e0 con 0x7f0ea80b3760 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ead395640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c3f0 tx=0x7f0e9000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017070 con 0x7f0ea80b3760 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e900052d0 con 0x7f0ea80b3760 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea80cb6c0 con 0x7f0ea80b3760 2024-09-12T02:34:20.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003830 con 0x7f0ea80b3760 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.694+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea80cbc80 con 0x7f0ea80b3760 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.695+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea80d1fe0 con 0x7f0ea80b3760 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.696+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e9001a070 con 0x7f0ea80b3760 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.696+0000 7f0ea57fa640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 0x7f0e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.696+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0e9008a3c0 con 0x7f0ea80b3760 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.696+0000 7f0eacb94640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 0x7f0e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.697+0000 7f0eacb94640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 0x7f0e8806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006fd0 tx=0x7f0ea0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.701+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e90058410 con 0x7f0ea80b3760 2024-09-12T02:34:20.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.866+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ea80b3cb0 con 0x7f0ea80b3760 2024-09-12T02:34:20.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.867+0000 7f0ea57fa640 1 -- 172.21.15.119:0/1209481605 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f0e9005c710 con 0x7f0ea80b3760 2024-09-12T02:34:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:20.868 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 msgr2=0x7f0e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 0x7f0e8806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006fd0 tx=0x7f0ea0008040 comp rx=0 tx=0).stop 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 msgr2=0x7f0ea80b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c3f0 tx=0x7f0e9000c7f0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 shutdown_connections 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0e8806be30 0x7f0e8806e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ea80b3760 0x7f0ea80b18c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea809aa30 0x7f0ea80b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 --2- 172.21.15.119:0/1209481605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ea806cd20 0x7f0ea815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 >> 172.21.15.119:0/1209481605 conn(0x7f0ea80d23a0 msgr2=0x7f0ea80b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 shutdown_connections 2024-09-12T02:34:20.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.869+0000 7f0eaedf8640 1 -- 172.21.15.119:0/1209481605 wait complete. 2024-09-12T02:34:20.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:34:20.881 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:20.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.978+0000 7f8a65f8d640 1 Processor -- start 2024-09-12T02:34:20.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.978+0000 7f8a65f8d640 1 -- start start 2024-09-12T02:34:20.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a65f8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a65f8d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 0x7f8a600ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a65f8d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600d01c0 con 0x7f8a6009b980 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a65f8d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8a600cff70 con 0x7f8a6015cf80 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a65f8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600d0dd0 con 0x7f8a6015c490 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a5f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a5ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 0x7f8a600ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.979+0000 7f8a5f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:52384/0 (socket says 172.21.15.119:52384) 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5f7fe640 1 -- 172.21.15.119:0/3520474497 learned_addr learned my addr 172.21.15.119:0/3520474497 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5f7fe640 1 -- 172.21.15.119:0/3520474497 >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 msgr2=0x7f8a600ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5f7fe640 1 --2- 172.21.15.119:0/3520474497 >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 0x7f8a600ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5f7fe640 1 -- 172.21.15.119:0/3520474497 >> v1:172.21.15.153:6789/0 conn(0x7f8a6009b980 legacy=0x7f8a6015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5f7fe640 1 -- 172.21.15.119:0/3520474497 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600d04a0 con 0x7f8a6015c490 2024-09-12T02:34:20.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.980+0000 7f8a5ffff640 1 --2- 172.21.15.119:0/3520474497 >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 0x7f8a600ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a5f7fe640 1 --2- 172.21.15.119:0/3520474497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4fc3f1a053e90f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a5e7fc640 1 -- 172.21.15.119:0/3520474497 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50037070 con 0x7f8a6015c490 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a5e7fc640 1 -- 172.21.15.119:0/3520474497 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5002ae50 con 0x7f8a6015c490 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a5e7fc640 1 -- 172.21.15.119:0/3520474497 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50032860 con 0x7f8a6015c490 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 -- 172.21.15.119:0/3520474497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 msgr2=0x7f8a6009b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/3520474497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5002a300 comp rx=0 tx=0).stop 2024-09-12T02:34:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 -- 172.21.15.119:0/3520474497 shutdown_connections 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/3520474497 >> v2:172.21.15.153:3300/0 conn(0x7f8a6015cf80 0x7f8a600ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/3520474497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6015c490 0x7f8a6009b440 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 -- 172.21.15.119:0/3520474497 >> 172.21.15.119:0/3520474497 conn(0x7f8a600d23a0 msgr2=0x7f8a600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 -- 172.21.15.119:0/3520474497 shutdown_connections 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.981+0000 7f8a65f8d640 1 -- 172.21.15.119:0/3520474497 wait complete. 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.982+0000 7f8a65f8d640 1 Processor -- start 2024-09-12T02:34:20.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 -- start start 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6009b980 0x7f8a600b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a6015c490 0x7f8a600c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600d1260 con 0x7f8a6015cf80 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600d0a60 con 0x7f8a6015c490 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.983+0000 7f8a65f8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600b7a10 con 0x7f8a6009b980 2024-09-12T02:34:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56672/0 (socket says 172.21.15.119:56672) 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 -- 172.21.15.119:0/2734657206 learned_addr learned my addr 172.21.15.119:0/2734657206 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5f7fe640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6009b980 0x7f8a600b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5effd640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a6015c490 0x7f8a600c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 -- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6009b980 msgr2=0x7f8a600b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6009b980 0x7f8a600b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 -- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a6015c490 msgr2=0x7f8a600c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a6015c490 0x7f8a600c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 -- 172.21.15.119:0/2734657206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600b6b40 con 0x7f8a6015cf80 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a5ffff640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800efc0 tx=0x7f8a5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58018030 con 0x7f8a6015cf80 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5800cdf0 con 0x7f8a6015cf80 2024-09-12T02:34:20.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58003bb0 con 0x7f8a6015cf80 2024-09-12T02:34:20.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a600b6e20 con 0x7f8a6015cf80 2024-09-12T02:34:20.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.984+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600c6cf0 con 0x7f8a6015cf80 2024-09-12T02:34:20.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.985+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a60068e80 con 0x7f8a6015cf80 2024-09-12T02:34:20.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.986+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a5801b070 con 0x7f8a6015cf80 2024-09-12T02:34:20.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.986+0000 7f8a47fff640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 0x7f8a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.986+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8a5808baf0 con 0x7f8a6015cf80 2024-09-12T02:34:20.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.986+0000 7f8a5f7fe640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 0x7f8a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.987+0000 7f8a5f7fe640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 0x7f8a4c06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a50034000 tx=0x7f8a5002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:20.990+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a60068e80 con 0x7f8a6015cf80 2024-09-12T02:34:21.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.155+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a6009b440 con 0x7f8a4c06be30 2024-09-12T02:34:21.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.163+0000 7f8a47fff640 1 -- 172.21.15.119:0/2734657206 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f8a50093310 con 0x7f8a4c06be30 2024-09-12T02:34:21.168 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:21.170 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 msgr2=0x7f8a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 0x7f8a4c06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a50034000 tx=0x7f8a5002e000 comp rx=0 tx=0).stop 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 msgr2=0x7f8a600cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800efc0 tx=0x7f8a5800c490 comp rx=0 tx=0).stop 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 shutdown_connections 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8a4c06be30 0x7f8a4c06e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6015cf80 0x7f8a600cb640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a6015c490 0x7f8a600c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 --2- 172.21.15.119:0/2734657206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a6009b980 0x7f8a600b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 >> 172.21.15.119:0/2734657206 conn(0x7f8a600d23a0 msgr2=0x7f8a600b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 shutdown_connections 2024-09-12T02:34:21.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.167+0000 7f8a65f8d640 1 -- 172.21.15.119:0/2734657206 wait complete. 2024-09-12T02:34:21.178 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T02:34:19.182482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219636,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755084,"statfs":{"total":773094113280,"available":772869206016,"internally_reserved":0,"allocated":3481600,"data_stored":2094460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003102"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347397+0000","last_change":"2024-09-12T02:34:00.057067+0000","last_active":"2024-09-12T02:34:07.347397+0000","last_peered":"2024-09-12T02:34:07.347397+0000","last_clean":"2024-09-12T02:34:07.347397+0000","last_became_active":"2024-09-12T02:34:00.056766+0000","last_became_peered":"2024-09-12T02:34:00.056766+0000","last_unstale":"2024-09-12T02:34:07.347397+0000","last_undegraded":"2024-09-12T02:34:07.347397+0000","last_fullsized":"2024-09-12T02:34:07.347397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:36.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562594+0000","last_change":"2024-09-12T02:34:01.061517+0000","last_active":"2024-09-12T02:34:08.562594+0000","last_peered":"2024-09-12T02:34:08.562594+0000","last_clean":"2024-09-12T02:34:08.562594+0000","last_became_active":"2024-09-12T02:34:01.061120+0000","last_became_peered":"2024-09-12T02:34:01.061120+0000","last_unstale":"2024-09-12T02:34:08.562594+0000","last_undegraded":"2024-09-12T02:34:08.562594+0000","last_fullsized":"2024-09-12T02:34:08.562594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:18.386298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562151+0000","last_change":"2024-09-12T02:34:05.658529+0000","last_active":"2024-09-12T02:34:08.562151+0000","last_peered":"2024-09-12T02:34:08.562151+0000","last_clean":"2024-09-12T02:34:08.562151+0000","last_became_active":"2024-09-12T02:34:05.658141+0000","last_became_peered":"2024-09-12T02:34:05.658141+0000","last_unstale":"2024-09-12T02:34:08.562151+0000","last_undegraded":"2024-09-12T02:34:08.562151+0000","last_fullsized":"2024-09-12T02:34:08.562151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:35.123440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561735+0000","last_change":"2024-09-12T02:34:00.059738+0000","last_active":"2024-09-12T02:34:08.561735+0000","last_peered":"2024-09-12T02:34:08.561735+0000","last_clean":"2024-09-12T02:34:08.561735+0000","last_became_active":"2024-09-12T02:34:00.059507+0000","last_became_peered":"2024-09-12T02:34:00.059507+0000","last_unstale":"2024-09-12T02:34:08.561735+0000","last_undegraded":"2024-09-12T02:34:08.561735+0000","last_fullsized":"2024-09-12T02:34:08.561735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347277+0000","last_change":"2024-09-12T02:34:01.066517+0000","last_active":"2024-09-12T02:34:07.347277+0000","last_peered":"2024-09-12T02:34:07.347277+0000","last_clean":"2024-09-12T02:34:07.347277+0000","last_became_active":"2024-09-12T02:34:01.066244+0000","last_became_peered":"2024-09-12T02:34:01.066244+0000","last_unstale":"2024-09-12T02:34:07.347277+0000","last_undegraded":"2024-09-12T02:34:07.347277+0000","last_fullsized":"2024-09-12T02:34:07.347277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094181+0000","last_change":"2024-09-12T02:34:05.080417+0000","last_active":"2024-09-12T02:34:07.094181+0000","last_peered":"2024-09-12T02:34:07.094181+0000","last_clean":"2024-09-12T02:34:07.094181+0000","last_became_active":"2024-09-12T02:34:05.079990+0000","last_became_peered":"2024-09-12T02:34:05.079990+0000","last_unstale":"2024-09-12T02:34:07.094181+0000","last_undegraded":"2024-09-12T02:34:07.094181+0000","last_fullsized":"2024-09-12T02:34:07.094181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:13.003179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835917+0000","last_change":"2024-09-12T02:34:00.065442+0000","last_active":"2024-09-12T02:34:08.835917+0000","last_peered":"2024-09-12T02:34:08.835917+0000","last_clean":"2024-09-12T02:34:08.835917+0000","last_became_active":"2024-09-12T02:34:00.065146+0000","last_became_peered":"2024-09-12T02:34:00.065146+0000","last_unstale":"2024-09-12T02:34:08.835917+0000","last_undegraded":"2024-09-12T02:34:08.835917+0000","last_fullsized":"2024-09-12T02:34:08.835917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:05.525436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895899+0000","last_change":"2024-09-12T02:34:01.063766+0000","last_active":"2024-09-12T02:34:07.895899+0000","last_peered":"2024-09-12T02:34:07.895899+0000","last_clean":"2024-09-12T02:34:07.895899+0000","last_became_active":"2024-09-12T02:34:01.063502+0000","last_became_peered":"2024-09-12T02:34:01.063502+0000","last_unstale":"2024-09-12T02:34:07.895899+0000","last_undegraded":"2024-09-12T02:34:07.895899+0000","last_fullsized":"2024-09-12T02:34:07.895899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093971+0000","last_change":"2024-09-12T02:34:05.079431+0000","last_active":"2024-09-12T02:34:07.093971+0000","last_peered":"2024-09-12T02:34:07.093971+0000","last_clean":"2024-09-12T02:34:07.093971+0000","last_became_active":"2024-09-12T02:34:05.079067+0000","last_became_peered":"2024-09-12T02:34:05.079067+0000","last_unstale":"2024-09-12T02:34:07.093971+0000","last_undegraded":"2024-09-12T02:34:07.093971+0000","last_fullsized":"2024-09-12T02:34:07.093971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835848+0000","last_change":"2024-09-12T02:34:00.061054+0000","last_active":"2024-09-12T02:34:08.835848+0000","last_peered":"2024-09-12T02:34:08.835848+0000","last_clean":"2024-09-12T02:34:08.835848+0000","last_became_active":"2024-09-12T02:34:00.060797+0000","last_became_peered":"2024-09-12T02:34:00.060797+0000","last_unstale":"2024-09-12T02:34:08.835848+0000","last_undegraded":"2024-09-12T02:34:08.835848+0000","last_fullsized":"2024-09-12T02:34:08.835848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896093+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:07.896093+0000","last_peered":"2024-09-12T02:34:07.896093+0000","last_clean":"2024-09-12T02:34:07.896093+0000","last_became_active":"2024-09-12T02:34:01.067112+0000","last_became_peered":"2024-09-12T02:34:01.067112+0000","last_unstale":"2024-09-12T02:34:07.896093+0000","last_undegraded":"2024-09-12T02:34:07.896093+0000","last_fullsized":"2024-09-12T02:34:07.896093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093944+0000","last_change":"2024-09-12T02:34:05.077446+0000","last_active":"2024-09-12T02:34:07.093944+0000","last_peered":"2024-09-12T02:34:07.093944+0000","last_clean":"2024-09-12T02:34:07.093944+0000","last_became_active":"2024-09-12T02:34:05.077106+0000","last_became_peered":"2024-09-12T02:34:05.077106+0000","last_unstale":"2024-09-12T02:34:07.093944+0000","last_undegraded":"2024-09-12T02:34:07.093944+0000","last_fullsized":"2024-09-12T02:34:07.093944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094605+0000","last_change":"2024-09-12T02:34:01.056215+0000","last_active":"2024-09-12T02:34:07.094605+0000","last_peered":"2024-09-12T02:34:07.094605+0000","last_clean":"2024-09-12T02:34:07.094605+0000","last_became_active":"2024-09-12T02:34:01.055913+0000","last_became_peered":"2024-09-12T02:34:01.055913+0000","last_unstale":"2024-09-12T02:34:07.094605+0000","last_undegraded":"2024-09-12T02:34:07.094605+0000","last_fullsized":"2024-09-12T02:34:07.094605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835838+0000","last_change":"2024-09-12T02:34:00.058795+0000","last_active":"2024-09-12T02:34:08.835838+0000","last_peered":"2024-09-12T02:34:08.835838+0000","last_clean":"2024-09-12T02:34:08.835838+0000","last_became_active":"2024-09-12T02:34:00.058542+0000","last_became_peered":"2024-09-12T02:34:00.058542+0000","last_unstale":"2024-09-12T02:34:08.835838+0000","last_undegraded":"2024-09-12T02:34:08.835838+0000","last_fullsized":"2024-09-12T02:34:08.835838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095266+0000","last_change":"2024-09-12T02:34:05.081285+0000","last_active":"2024-09-12T02:34:07.095266+0000","last_peered":"2024-09-12T02:34:07.095266+0000","last_clean":"2024-09-12T02:34:07.095266+0000","last_became_active":"2024-09-12T02:34:05.080737+0000","last_became_peered":"2024-09-12T02:34:05.080737+0000","last_unstale":"2024-09-12T02:34:07.095266+0000","last_undegraded":"2024-09-12T02:34:07.095266+0000","last_fullsized":"2024-09-12T02:34:07.095266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562380+0000","last_change":"2024-09-12T02:34:01.058977+0000","last_active":"2024-09-12T02:34:08.562380+0000","last_peered":"2024-09-12T02:34:08.562380+0000","last_clean":"2024-09-12T02:34:08.562380+0000","last_became_active":"2024-09-12T02:34:01.058631+0000","last_became_peered":"2024-09-12T02:34:01.058631+0000","last_unstale":"2024-09-12T02:34:08.562380+0000","last_undegraded":"2024-09-12T02:34:08.562380+0000","last_fullsized":"2024-09-12T02:34:08.562380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:31.239556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265847+0000","last_change":"2024-09-12T02:34:00.058689+0000","last_active":"2024-09-12T02:34:07.265847+0000","last_peered":"2024-09-12T02:34:07.265847+0000","last_clean":"2024-09-12T02:34:07.265847+0000","last_became_active":"2024-09-12T02:34:00.058428+0000","last_became_peered":"2024-09-12T02:34:00.058428+0000","last_unstale":"2024-09-12T02:34:07.265847+0000","last_undegraded":"2024-09-12T02:34:07.265847+0000","last_fullsized":"2024-09-12T02:34:07.265847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095071+0000","last_change":"2024-09-12T02:34:05.080503+0000","last_active":"2024-09-12T02:34:07.095071+0000","last_peered":"2024-09-12T02:34:07.095071+0000","last_clean":"2024-09-12T02:34:07.095071+0000","last_became_active":"2024-09-12T02:34:05.080079+0000","last_became_peered":"2024-09-12T02:34:05.080079+0000","last_unstale":"2024-09-12T02:34:07.095071+0000","last_undegraded":"2024-09-12T02:34:07.095071+0000","last_fullsized":"2024-09-12T02:34:07.095071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562242+0000","last_change":"2024-09-12T02:34:01.050151+0000","last_active":"2024-09-12T02:34:08.562242+0000","last_peered":"2024-09-12T02:34:08.562242+0000","last_clean":"2024-09-12T02:34:08.562242+0000","last_became_active":"2024-09-12T02:34:01.049816+0000","last_became_peered":"2024-09-12T02:34:01.049816+0000","last_unstale":"2024-09-12T02:34:08.562242+0000","last_undegraded":"2024-09-12T02:34:08.562242+0000","last_fullsized":"2024-09-12T02:34:08.562242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:24.977490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265581+0000","last_change":"2024-09-12T02:34:00.056061+0000","last_active":"2024-09-12T02:34:07.265581+0000","last_peered":"2024-09-12T02:34:07.265581+0000","last_clean":"2024-09-12T02:34:07.265581+0000","last_became_active":"2024-09-12T02:34:00.055702+0000","last_became_peered":"2024-09-12T02:34:00.055702+0000","last_unstale":"2024-09-12T02:34:07.265581+0000","last_undegraded":"2024-09-12T02:34:07.265581+0000","last_fullsized":"2024-09-12T02:34:07.265581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266184+0000","last_change":"2024-09-12T02:34:05.658591+0000","last_active":"2024-09-12T02:34:07.266184+0000","last_peered":"2024-09-12T02:34:07.266184+0000","last_clean":"2024-09-12T02:34:07.266184+0000","last_became_active":"2024-09-12T02:34:05.658221+0000","last_became_peered":"2024-09-12T02:34:05.658221+0000","last_unstale":"2024-09-12T02:34:07.266184+0000","last_undegraded":"2024-09-12T02:34:07.266184+0000","last_fullsized":"2024-09-12T02:34:07.266184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095029+0000","last_change":"2024-09-12T02:34:01.063254+0000","last_active":"2024-09-12T02:34:07.095029+0000","last_peered":"2024-09-12T02:34:07.095029+0000","last_clean":"2024-09-12T02:34:07.095029+0000","last_became_active":"2024-09-12T02:34:01.062975+0000","last_became_peered":"2024-09-12T02:34:01.062975+0000","last_unstale":"2024-09-12T02:34:07.095029+0000","last_undegraded":"2024-09-12T02:34:07.095029+0000","last_fullsized":"2024-09-12T02:34:07.095029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:58.049718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835835+0000","last_change":"2024-09-12T02:34:00.060051+0000","last_active":"2024-09-12T02:34:08.835835+0000","last_peered":"2024-09-12T02:34:08.835835+0000","last_clean":"2024-09-12T02:34:08.835835+0000","last_became_active":"2024-09-12T02:34:00.059298+0000","last_became_peered":"2024-09-12T02:34:00.059298+0000","last_unstale":"2024-09-12T02:34:08.835835+0000","last_undegraded":"2024-09-12T02:34:08.835835+0000","last_fullsized":"2024-09-12T02:34:08.835835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094722+0000","last_change":"2024-09-12T02:34:05.080851+0000","last_active":"2024-09-12T02:34:07.094722+0000","last_peered":"2024-09-12T02:34:07.094722+0000","last_clean":"2024-09-12T02:34:07.094722+0000","last_became_active":"2024-09-12T02:34:05.080409+0000","last_became_peered":"2024-09-12T02:34:05.080409+0000","last_unstale":"2024-09-12T02:34:07.094722+0000","last_undegraded":"2024-09-12T02:34:07.094722+0000","last_fullsized":"2024-09-12T02:34:07.094722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347589+0000","last_change":"2024-09-12T02:34:01.052544+0000","last_active":"2024-09-12T02:34:07.347589+0000","last_peered":"2024-09-12T02:34:07.347589+0000","last_clean":"2024-09-12T02:34:07.347589+0000","last_became_active":"2024-09-12T02:34:01.052248+0000","last_became_peered":"2024-09-12T02:34:01.052248+0000","last_unstale":"2024-09-12T02:34:07.347589+0000","last_undegraded":"2024-09-12T02:34:07.347589+0000","last_fullsized":"2024-09-12T02:34:07.347589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095474+0000","last_change":"2024-09-12T02:34:00.056829+0000","last_active":"2024-09-12T02:34:07.095474+0000","last_peered":"2024-09-12T02:34:07.095474+0000","last_clean":"2024-09-12T02:34:07.095474+0000","last_became_active":"2024-09-12T02:34:00.056507+0000","last_became_peered":"2024-09-12T02:34:00.056507+0000","last_unstale":"2024-09-12T02:34:07.095474+0000","last_undegraded":"2024-09-12T02:34:07.095474+0000","last_fullsized":"2024-09-12T02:34:07.095474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094358+0000","last_change":"2024-09-12T02:34:05.658703+0000","last_active":"2024-09-12T02:34:07.094358+0000","last_peered":"2024-09-12T02:34:07.094358+0000","last_clean":"2024-09-12T02:34:07.094358+0000","last_became_active":"2024-09-12T02:34:05.658284+0000","last_became_peered":"2024-09-12T02:34:05.658284+0000","last_unstale":"2024-09-12T02:34:07.094358+0000","last_undegraded":"2024-09-12T02:34:07.094358+0000","last_fullsized":"2024-09-12T02:34:07.094358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562853+0000","last_change":"2024-09-12T02:34:01.062483+0000","last_active":"2024-09-12T02:34:08.562853+0000","last_peered":"2024-09-12T02:34:08.562853+0000","last_clean":"2024-09-12T02:34:08.562853+0000","last_became_active":"2024-09-12T02:34:01.062172+0000","last_became_peered":"2024-09-12T02:34:01.062172+0000","last_unstale":"2024-09-12T02:34:08.562853+0000","last_undegraded":"2024-09-12T02:34:08.562853+0000","last_fullsized":"2024-09-12T02:34:08.562853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:34.983530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266195+0000","last_change":"2024-09-12T02:34:00.052655+0000","last_active":"2024-09-12T02:34:07.266195+0000","last_peered":"2024-09-12T02:34:07.266195+0000","last_clean":"2024-09-12T02:34:07.266195+0000","last_became_active":"2024-09-12T02:34:00.051516+0000","last_became_peered":"2024-09-12T02:34:00.051516+0000","last_unstale":"2024-09-12T02:34:07.266195+0000","last_undegraded":"2024-09-12T02:34:07.266195+0000","last_fullsized":"2024-09-12T02:34:07.266195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562000+0000","last_change":"2024-09-12T02:34:05.658723+0000","last_active":"2024-09-12T02:34:08.562000+0000","last_peered":"2024-09-12T02:34:08.562000+0000","last_clean":"2024-09-12T02:34:08.562000+0000","last_became_active":"2024-09-12T02:34:05.658328+0000","last_became_peered":"2024-09-12T02:34:05.658328+0000","last_unstale":"2024-09-12T02:34:08.562000+0000","last_undegraded":"2024-09-12T02:34:08.562000+0000","last_fullsized":"2024-09-12T02:34:08.562000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.652938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.050206+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049932+0000","last_became_peered":"2024-09-12T02:34:01.049932+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835876+0000","last_change":"2024-09-12T02:34:00.060227+0000","last_active":"2024-09-12T02:34:08.835876+0000","last_peered":"2024-09-12T02:34:08.835876+0000","last_clean":"2024-09-12T02:34:08.835876+0000","last_became_active":"2024-09-12T02:34:00.059857+0000","last_became_peered":"2024-09-12T02:34:00.059857+0000","last_unstale":"2024-09-12T02:34:08.835876+0000","last_undegraded":"2024-09-12T02:34:08.835876+0000","last_fullsized":"2024-09-12T02:34:08.835876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:35.697987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347145+0000","last_change":"2024-09-12T02:34:05.656856+0000","last_active":"2024-09-12T02:34:07.347145+0000","last_peered":"2024-09-12T02:34:07.347145+0000","last_clean":"2024-09-12T02:34:07.347145+0000","last_became_active":"2024-09-12T02:34:05.656368+0000","last_became_peered":"2024-09-12T02:34:05.656368+0000","last_unstale":"2024-09-12T02:34:07.347145+0000","last_undegraded":"2024-09-12T02:34:07.347145+0000","last_fullsized":"2024-09-12T02:34:07.347145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896211+0000","last_change":"2024-09-12T02:34:01.064917+0000","last_active":"2024-09-12T02:34:07.896211+0000","last_peered":"2024-09-12T02:34:07.896211+0000","last_clean":"2024-09-12T02:34:07.896211+0000","last_became_active":"2024-09-12T02:34:01.064584+0000","last_became_peered":"2024-09-12T02:34:01.064584+0000","last_unstale":"2024-09-12T02:34:07.896211+0000","last_undegraded":"2024-09-12T02:34:07.896211+0000","last_fullsized":"2024-09-12T02:34:07.896211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266024+0000","last_change":"2024-09-12T02:34:00.058032+0000","last_active":"2024-09-12T02:34:07.266024+0000","last_peered":"2024-09-12T02:34:07.266024+0000","last_clean":"2024-09-12T02:34:07.266024+0000","last_became_active":"2024-09-12T02:34:00.057761+0000","last_became_peered":"2024-09-12T02:34:00.057761+0000","last_unstale":"2024-09-12T02:34:07.266024+0000","last_undegraded":"2024-09-12T02:34:07.266024+0000","last_fullsized":"2024-09-12T02:34:07.266024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265571+0000","last_change":"2024-09-12T02:34:05.084537+0000","last_active":"2024-09-12T02:34:07.265571+0000","last_peered":"2024-09-12T02:34:07.265571+0000","last_clean":"2024-09-12T02:34:07.265571+0000","last_became_active":"2024-09-12T02:34:05.084024+0000","last_became_peered":"2024-09-12T02:34:05.084024+0000","last_unstale":"2024-09-12T02:34:07.265571+0000","last_undegraded":"2024-09-12T02:34:07.265571+0000","last_fullsized":"2024-09-12T02:34:07.265571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095347+0000","last_change":"2024-09-12T02:34:01.062564+0000","last_active":"2024-09-12T02:34:07.095347+0000","last_peered":"2024-09-12T02:34:07.095347+0000","last_clean":"2024-09-12T02:34:07.095347+0000","last_became_active":"2024-09-12T02:34:01.062007+0000","last_became_peered":"2024-09-12T02:34:01.062007+0000","last_unstale":"2024-09-12T02:34:07.095347+0000","last_undegraded":"2024-09-12T02:34:07.095347+0000","last_fullsized":"2024-09-12T02:34:07.095347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:57.201089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896147+0000","last_change":"2024-09-12T02:34:00.057767+0000","last_active":"2024-09-12T02:34:07.896147+0000","last_peered":"2024-09-12T02:34:07.896147+0000","last_clean":"2024-09-12T02:34:07.896147+0000","last_became_active":"2024-09-12T02:34:00.057309+0000","last_became_peered":"2024-09-12T02:34:00.057309+0000","last_unstale":"2024-09-12T02:34:07.896147+0000","last_undegraded":"2024-09-12T02:34:07.896147+0000","last_fullsized":"2024-09-12T02:34:07.896147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265935+0000","last_change":"2024-09-12T02:34:05.080386+0000","last_active":"2024-09-12T02:34:07.265935+0000","last_peered":"2024-09-12T02:34:07.265935+0000","last_clean":"2024-09-12T02:34:07.265935+0000","last_became_active":"2024-09-12T02:34:05.079869+0000","last_became_peered":"2024-09-12T02:34:05.079869+0000","last_unstale":"2024-09-12T02:34:07.265935+0000","last_undegraded":"2024-09-12T02:34:07.265935+0000","last_fullsized":"2024-09-12T02:34:07.265935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265585+0000","last_change":"2024-09-12T02:34:01.048210+0000","last_active":"2024-09-12T02:34:07.265585+0000","last_peered":"2024-09-12T02:34:07.265585+0000","last_clean":"2024-09-12T02:34:07.265585+0000","last_became_active":"2024-09-12T02:34:01.047883+0000","last_became_peered":"2024-09-12T02:34:01.047883+0000","last_unstale":"2024-09-12T02:34:07.265585+0000","last_undegraded":"2024-09-12T02:34:07.265585+0000","last_fullsized":"2024-09-12T02:34:07.265585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090263+0000","last_change":"2024-09-12T02:34:00.052517+0000","last_active":"2024-09-12T02:34:07.090263+0000","last_peered":"2024-09-12T02:34:07.090263+0000","last_clean":"2024-09-12T02:34:07.090263+0000","last_became_active":"2024-09-12T02:34:00.052229+0000","last_became_peered":"2024-09-12T02:34:00.052229+0000","last_unstale":"2024-09-12T02:34:07.090263+0000","last_undegraded":"2024-09-12T02:34:07.090263+0000","last_fullsized":"2024-09-12T02:34:07.090263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:52.608734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266180+0000","last_change":"2024-09-12T02:34:05.079492+0000","last_active":"2024-09-12T02:34:07.266180+0000","last_peered":"2024-09-12T02:34:07.266180+0000","last_clean":"2024-09-12T02:34:07.266180+0000","last_became_active":"2024-09-12T02:34:05.079114+0000","last_became_peered":"2024-09-12T02:34:05.079114+0000","last_unstale":"2024-09-12T02:34:07.266180+0000","last_undegraded":"2024-09-12T02:34:07.266180+0000","last_fullsized":"2024-09-12T02:34:07.266180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.346986+0000","last_change":"2024-09-12T02:34:01.057070+0000","last_active":"2024-09-12T02:34:07.346986+0000","last_peered":"2024-09-12T02:34:07.346986+0000","last_clean":"2024-09-12T02:34:07.346986+0000","last_became_active":"2024-09-12T02:34:01.056658+0000","last_became_peered":"2024-09-12T02:34:01.056658+0000","last_unstale":"2024-09-12T02:34:07.346986+0000","last_undegraded":"2024-09-12T02:34:07.346986+0000","last_fullsized":"2024-09-12T02:34:07.346986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.216224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835827+0000","last_change":"2024-09-12T02:34:00.061960+0000","last_active":"2024-09-12T02:34:08.835827+0000","last_peered":"2024-09-12T02:34:08.835827+0000","last_clean":"2024-09-12T02:34:08.835827+0000","last_became_active":"2024-09-12T02:34:00.061710+0000","last_became_peered":"2024-09-12T02:34:00.061710+0000","last_unstale":"2024-09-12T02:34:08.835827+0000","last_undegraded":"2024-09-12T02:34:08.835827+0000","last_fullsized":"2024-09-12T02:34:08.835827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347500+0000","last_change":"2024-09-12T02:34:05.658955+0000","last_active":"2024-09-12T02:34:07.347500+0000","last_peered":"2024-09-12T02:34:07.347500+0000","last_clean":"2024-09-12T02:34:07.347500+0000","last_became_active":"2024-09-12T02:34:05.657958+0000","last_became_peered":"2024-09-12T02:34:05.657958+0000","last_unstale":"2024-09-12T02:34:07.347500+0000","last_undegraded":"2024-09-12T02:34:07.347500+0000","last_fullsized":"2024-09-12T02:34:07.347500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562253+0000","last_change":"2024-09-12T02:34:01.067308+0000","last_active":"2024-09-12T02:34:08.562253+0000","last_peered":"2024-09-12T02:34:08.562253+0000","last_clean":"2024-09-12T02:34:08.562253+0000","last_became_active":"2024-09-12T02:34:01.066973+0000","last_became_peered":"2024-09-12T02:34:01.066973+0000","last_unstale":"2024-09-12T02:34:08.562253+0000","last_undegraded":"2024-09-12T02:34:08.562253+0000","last_fullsized":"2024-09-12T02:34:08.562253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.656076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895930+0000","last_change":"2024-09-12T02:34:00.055611+0000","last_active":"2024-09-12T02:34:07.895930+0000","last_peered":"2024-09-12T02:34:07.895930+0000","last_clean":"2024-09-12T02:34:07.895930+0000","last_became_active":"2024-09-12T02:34:00.055344+0000","last_became_peered":"2024-09-12T02:34:00.055344+0000","last_unstale":"2024-09-12T02:34:07.895930+0000","last_undegraded":"2024-09-12T02:34:07.895930+0000","last_fullsized":"2024-09-12T02:34:07.895930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836209+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:08.836209+0000","last_peered":"2024-09-12T02:34:08.836209+0000","last_clean":"2024-09-12T02:34:08.836209+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:08.836209+0000","last_undegraded":"2024-09-12T02:34:08.836209+0000","last_fullsized":"2024-09-12T02:34:08.836209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095519+0000","last_change":"2024-09-12T02:34:05.658756+0000","last_active":"2024-09-12T02:34:07.095519+0000","last_peered":"2024-09-12T02:34:07.095519+0000","last_clean":"2024-09-12T02:34:07.095519+0000","last_became_active":"2024-09-12T02:34:05.658203+0000","last_became_peered":"2024-09-12T02:34:05.658203+0000","last_unstale":"2024-09-12T02:34:07.095519+0000","last_undegraded":"2024-09-12T02:34:07.095519+0000","last_fullsized":"2024-09-12T02:34:07.095519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836636+0000","last_change":"2024-09-12T02:34:01.069608+0000","last_active":"2024-09-12T02:34:08.836636+0000","last_peered":"2024-09-12T02:34:08.836636+0000","last_clean":"2024-09-12T02:34:08.836636+0000","last_became_active":"2024-09-12T02:34:01.069122+0000","last_became_peered":"2024-09-12T02:34:01.069122+0000","last_unstale":"2024-09-12T02:34:08.836636+0000","last_undegraded":"2024-09-12T02:34:08.836636+0000","last_fullsized":"2024-09-12T02:34:08.836636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090639+0000","last_change":"2024-09-12T02:34:00.054247+0000","last_active":"2024-09-12T02:34:07.090639+0000","last_peered":"2024-09-12T02:34:07.090639+0000","last_clean":"2024-09-12T02:34:07.090639+0000","last_became_active":"2024-09-12T02:34:00.053946+0000","last_became_peered":"2024-09-12T02:34:00.053946+0000","last_unstale":"2024-09-12T02:34:07.090639+0000","last_undegraded":"2024-09-12T02:34:07.090639+0000","last_fullsized":"2024-09-12T02:34:07.090639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:07.754916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:05.656456+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:05.656039+0000","last_became_peered":"2024-09-12T02:34:05.656039+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.059721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895983+0000","last_change":"2024-09-12T02:34:01.066544+0000","last_active":"2024-09-12T02:34:07.895983+0000","last_peered":"2024-09-12T02:34:07.895983+0000","last_clean":"2024-09-12T02:34:07.895983+0000","last_became_active":"2024-09-12T02:34:01.065801+0000","last_became_peered":"2024-09-12T02:34:01.065801+0000","last_unstale":"2024-09-12T02:34:07.895983+0000","last_undegraded":"2024-09-12T02:34:07.895983+0000","last_fullsized":"2024-09-12T02:34:07.895983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266060+0000","last_change":"2024-09-12T02:34:00.053363+0000","last_active":"2024-09-12T02:34:07.266060+0000","last_peered":"2024-09-12T02:34:07.266060+0000","last_clean":"2024-09-12T02:34:07.266060+0000","last_became_active":"2024-09-12T02:34:00.053091+0000","last_became_peered":"2024-09-12T02:34:00.053091+0000","last_unstale":"2024-09-12T02:34:07.266060+0000","last_undegraded":"2024-09-12T02:34:07.266060+0000","last_fullsized":"2024-09-12T02:34:07.266060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347382+0000","last_change":"2024-09-12T02:34:05.083388+0000","last_active":"2024-09-12T02:34:07.347382+0000","last_peered":"2024-09-12T02:34:07.347382+0000","last_clean":"2024-09-12T02:34:07.347382+0000","last_became_active":"2024-09-12T02:34:05.082457+0000","last_became_peered":"2024-09-12T02:34:05.082457+0000","last_unstale":"2024-09-12T02:34:07.347382+0000","last_undegraded":"2024-09-12T02:34:07.347382+0000","last_fullsized":"2024-09-12T02:34:07.347382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836912+0000","last_change":"2024-09-12T02:34:01.074931+0000","last_active":"2024-09-12T02:34:08.836912+0000","last_peered":"2024-09-12T02:34:08.836912+0000","last_clean":"2024-09-12T02:34:08.836912+0000","last_became_active":"2024-09-12T02:34:01.074653+0000","last_became_peered":"2024-09-12T02:34:01.074653+0000","last_unstale":"2024-09-12T02:34:08.836912+0000","last_undegraded":"2024-09-12T02:34:08.836912+0000","last_fullsized":"2024-09-12T02:34:08.836912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:43.458949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090480+0000","last_change":"2024-09-12T02:34:00.055519+0000","last_active":"2024-09-12T02:34:07.090480+0000","last_peered":"2024-09-12T02:34:07.090480+0000","last_clean":"2024-09-12T02:34:07.090480+0000","last_became_active":"2024-09-12T02:34:00.055196+0000","last_became_peered":"2024-09-12T02:34:00.055196+0000","last_unstale":"2024-09-12T02:34:07.090480+0000","last_undegraded":"2024-09-12T02:34:07.090480+0000","last_fullsized":"2024-09-12T02:34:07.090480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.742903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895518+0000","last_change":"2024-09-12T02:34:05.658643+0000","last_active":"2024-09-12T02:34:07.895518+0000","last_peered":"2024-09-12T02:34:07.895518+0000","last_clean":"2024-09-12T02:34:07.895518+0000","last_became_active":"2024-09-12T02:34:05.658201+0000","last_became_peered":"2024-09-12T02:34:05.658201+0000","last_unstale":"2024-09-12T02:34:07.895518+0000","last_undegraded":"2024-09-12T02:34:07.895518+0000","last_fullsized":"2024-09-12T02:34:07.895518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.544978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836870+0000","last_change":"2024-09-12T02:34:01.068158+0000","last_active":"2024-09-12T02:34:08.836870+0000","last_peered":"2024-09-12T02:34:08.836870+0000","last_clean":"2024-09-12T02:34:08.836870+0000","last_became_active":"2024-09-12T02:34:01.067814+0000","last_became_peered":"2024-09-12T02:34:01.067814+0000","last_unstale":"2024-09-12T02:34:08.836870+0000","last_undegraded":"2024-09-12T02:34:08.836870+0000","last_fullsized":"2024-09-12T02:34:08.836870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095425+0000","last_change":"2024-09-12T02:34:00.057323+0000","last_active":"2024-09-12T02:34:07.095425+0000","last_peered":"2024-09-12T02:34:07.095425+0000","last_clean":"2024-09-12T02:34:07.095425+0000","last_became_active":"2024-09-12T02:34:00.057029+0000","last_became_peered":"2024-09-12T02:34:00.057029+0000","last_unstale":"2024-09-12T02:34:07.095425+0000","last_undegraded":"2024-09-12T02:34:07.095425+0000","last_fullsized":"2024-09-12T02:34:07.095425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:59.639173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094272+0000","last_change":"2024-09-12T02:34:05.079794+0000","last_active":"2024-09-12T02:34:07.094272+0000","last_peered":"2024-09-12T02:34:07.094272+0000","last_clean":"2024-09-12T02:34:07.094272+0000","last_became_active":"2024-09-12T02:34:05.079405+0000","last_became_peered":"2024-09-12T02:34:05.079405+0000","last_unstale":"2024-09-12T02:34:07.094272+0000","last_undegraded":"2024-09-12T02:34:07.094272+0000","last_fullsized":"2024-09-12T02:34:07.094272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836441+0000","last_change":"2024-09-12T02:34:01.057423+0000","last_active":"2024-09-12T02:34:08.836441+0000","last_peered":"2024-09-12T02:34:08.836441+0000","last_clean":"2024-09-12T02:34:08.836441+0000","last_became_active":"2024-09-12T02:34:01.057128+0000","last_became_peered":"2024-09-12T02:34:01.057128+0000","last_unstale":"2024-09-12T02:34:08.836441+0000","last_undegraded":"2024-09-12T02:34:08.836441+0000","last_fullsized":"2024-09-12T02:34:08.836441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090168+0000","last_change":"2024-09-12T02:34:00.048532+0000","last_active":"2024-09-12T02:34:07.090168+0000","last_peered":"2024-09-12T02:34:07.090168+0000","last_clean":"2024-09-12T02:34:07.090168+0000","last_became_active":"2024-09-12T02:34:00.048245+0000","last_became_peered":"2024-09-12T02:34:00.048245+0000","last_unstale":"2024-09-12T02:34:07.090168+0000","last_undegraded":"2024-09-12T02:34:07.090168+0000","last_fullsized":"2024-09-12T02:34:07.090168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:23.482609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347436+0000","last_change":"2024-09-12T02:34:05.079264+0000","last_active":"2024-09-12T02:34:07.347436+0000","last_peered":"2024-09-12T02:34:07.347436+0000","last_clean":"2024-09-12T02:34:07.347436+0000","last_became_active":"2024-09-12T02:34:05.078754+0000","last_became_peered":"2024-09-12T02:34:05.078754+0000","last_unstale":"2024-09-12T02:34:07.347436+0000","last_undegraded":"2024-09-12T02:34:07.347436+0000","last_fullsized":"2024-09-12T02:34:07.347436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094120+0000","last_change":"2024-09-12T02:34:01.060623+0000","last_active":"2024-09-12T02:34:07.094120+0000","last_peered":"2024-09-12T02:34:07.094120+0000","last_clean":"2024-09-12T02:34:07.094120+0000","last_became_active":"2024-09-12T02:34:01.060339+0000","last_became_peered":"2024-09-12T02:34:01.060339+0000","last_unstale":"2024-09-12T02:34:07.094120+0000","last_undegraded":"2024-09-12T02:34:07.094120+0000","last_fullsized":"2024-09-12T02:34:07.094120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:00.051189+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:00.050920+0000","last_became_peered":"2024-09-12T02:34:00.050920+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562819+0000","last_change":"2024-09-12T02:34:05.658569+0000","last_active":"2024-09-12T02:34:08.562819+0000","last_peered":"2024-09-12T02:34:08.562819+0000","last_clean":"2024-09-12T02:34:08.562819+0000","last_became_active":"2024-09-12T02:34:05.658174+0000","last_became_peered":"2024-09-12T02:34:05.658174+0000","last_unstale":"2024-09-12T02:34:08.562819+0000","last_undegraded":"2024-09-12T02:34:08.562819+0000","last_fullsized":"2024-09-12T02:34:08.562819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:28.956735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836570+0000","last_change":"2024-09-12T02:34:01.065005+0000","last_active":"2024-09-12T02:34:08.836570+0000","last_peered":"2024-09-12T02:34:08.836570+0000","last_clean":"2024-09-12T02:34:08.836570+0000","last_became_active":"2024-09-12T02:34:01.064722+0000","last_became_peered":"2024-09-12T02:34:01.064722+0000","last_unstale":"2024-09-12T02:34:08.836570+0000","last_undegraded":"2024-09-12T02:34:08.836570+0000","last_fullsized":"2024-09-12T02:34:08.836570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895958+0000","last_change":"2024-09-12T02:34:00.058485+0000","last_active":"2024-09-12T02:34:07.895958+0000","last_peered":"2024-09-12T02:34:07.895958+0000","last_clean":"2024-09-12T02:34:07.895958+0000","last_became_active":"2024-09-12T02:34:00.058013+0000","last_became_peered":"2024-09-12T02:34:00.058013+0000","last_unstale":"2024-09-12T02:34:07.895958+0000","last_undegraded":"2024-09-12T02:34:07.895958+0000","last_fullsized":"2024-09-12T02:34:07.895958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562509+0000","last_change":"2024-09-12T02:34:05.659437+0000","last_active":"2024-09-12T02:34:08.562509+0000","last_peered":"2024-09-12T02:34:08.562509+0000","last_clean":"2024-09-12T02:34:08.562509+0000","last_became_active":"2024-09-12T02:34:05.658091+0000","last_became_peered":"2024-09-12T02:34:05.658091+0000","last_unstale":"2024-09-12T02:34:08.562509+0000","last_undegraded":"2024-09-12T02:34:08.562509+0000","last_fullsized":"2024-09-12T02:34:08.562509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:49.468958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347237+0000","last_change":"2024-09-12T02:34:01.058834+0000","last_active":"2024-09-12T02:34:07.347237+0000","last_peered":"2024-09-12T02:34:07.347237+0000","last_clean":"2024-09-12T02:34:07.347237+0000","last_became_active":"2024-09-12T02:34:01.058557+0000","last_became_peered":"2024-09-12T02:34:01.058557+0000","last_unstale":"2024-09-12T02:34:07.347237+0000","last_undegraded":"2024-09-12T02:34:07.347237+0000","last_fullsized":"2024-09-12T02:34:07.347237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347544+0000","last_change":"2024-09-12T02:34:00.057001+0000","last_active":"2024-09-12T02:34:07.347544+0000","last_peered":"2024-09-12T02:34:07.347544+0000","last_clean":"2024-09-12T02:34:07.347544+0000","last_became_active":"2024-09-12T02:34:00.056685+0000","last_became_peered":"2024-09-12T02:34:00.056685+0000","last_unstale":"2024-09-12T02:34:07.347544+0000","last_undegraded":"2024-09-12T02:34:07.347544+0000","last_fullsized":"2024-09-12T02:34:07.347544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.793722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896082+0000","last_change":"2024-09-12T02:34:05.660619+0000","last_active":"2024-09-12T02:34:07.896082+0000","last_peered":"2024-09-12T02:34:07.896082+0000","last_clean":"2024-09-12T02:34:07.896082+0000","last_became_active":"2024-09-12T02:34:05.659790+0000","last_became_peered":"2024-09-12T02:34:05.659790+0000","last_unstale":"2024-09-12T02:34:07.896082+0000","last_undegraded":"2024-09-12T02:34:07.896082+0000","last_fullsized":"2024-09-12T02:34:07.896082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:38.472945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836579+0000","last_change":"2024-09-12T02:34:01.069392+0000","last_active":"2024-09-12T02:34:08.836579+0000","last_peered":"2024-09-12T02:34:08.836579+0000","last_clean":"2024-09-12T02:34:08.836579+0000","last_became_active":"2024-09-12T02:34:01.069065+0000","last_became_peered":"2024-09-12T02:34:01.069065+0000","last_unstale":"2024-09-12T02:34:08.836579+0000","last_undegraded":"2024-09-12T02:34:08.836579+0000","last_fullsized":"2024-09-12T02:34:08.836579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:10.464560+0000","last_change":"2024-09-12T02:34:00.058230+0000","last_active":"2024-09-12T02:34:10.464560+0000","last_peered":"2024-09-12T02:34:10.464560+0000","last_clean":"2024-09-12T02:34:10.464560+0000","last_became_active":"2024-09-12T02:34:00.057965+0000","last_became_peered":"2024-09-12T02:34:00.057965+0000","last_unstale":"2024-09-12T02:34:10.464560+0000","last_undegraded":"2024-09-12T02:34:10.464560+0000","last_fullsized":"2024-09-12T02:34:10.464560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265696+0000","last_change":"2024-09-12T02:34:05.084205+0000","last_active":"2024-09-12T02:34:07.265696+0000","last_peered":"2024-09-12T02:34:07.265696+0000","last_clean":"2024-09-12T02:34:07.265696+0000","last_became_active":"2024-09-12T02:34:05.083830+0000","last_became_peered":"2024-09-12T02:34:05.083830+0000","last_unstale":"2024-09-12T02:34:07.265696+0000","last_undegraded":"2024-09-12T02:34:07.265696+0000","last_fullsized":"2024-09-12T02:34:07.265696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095341+0000","last_change":"2024-09-12T02:34:01.059209+0000","last_active":"2024-09-12T02:34:07.095341+0000","last_peered":"2024-09-12T02:34:07.095341+0000","last_clean":"2024-09-12T02:34:07.095341+0000","last_became_active":"2024-09-12T02:34:01.058918+0000","last_became_peered":"2024-09-12T02:34:01.058918+0000","last_unstale":"2024-09-12T02:34:07.095341+0000","last_undegraded":"2024-09-12T02:34:07.095341+0000","last_fullsized":"2024-09-12T02:34:07.095341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.313534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266057+0000","last_change":"2024-09-12T02:34:00.054000+0000","last_active":"2024-09-12T02:34:07.266057+0000","last_peered":"2024-09-12T02:34:07.266057+0000","last_clean":"2024-09-12T02:34:07.266057+0000","last_became_active":"2024-09-12T02:34:00.053740+0000","last_became_peered":"2024-09-12T02:34:00.053740+0000","last_unstale":"2024-09-12T02:34:07.266057+0000","last_undegraded":"2024-09-12T02:34:07.266057+0000","last_fullsized":"2024-09-12T02:34:07.266057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094290+0000","last_change":"2024-09-12T02:34:05.076783+0000","last_active":"2024-09-12T02:34:07.094290+0000","last_peered":"2024-09-12T02:34:07.094290+0000","last_clean":"2024-09-12T02:34:07.094290+0000","last_became_active":"2024-09-12T02:34:05.076363+0000","last_became_peered":"2024-09-12T02:34:05.076363+0000","last_unstale":"2024-09-12T02:34:07.094290+0000","last_undegraded":"2024-09-12T02:34:07.094290+0000","last_fullsized":"2024-09-12T02:34:07.094290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:25.870250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347370+0000","last_change":"2024-09-12T02:34:01.066781+0000","last_active":"2024-09-12T02:34:07.347370+0000","last_peered":"2024-09-12T02:34:07.347370+0000","last_clean":"2024-09-12T02:34:07.347370+0000","last_became_active":"2024-09-12T02:34:01.066488+0000","last_became_peered":"2024-09-12T02:34:01.066488+0000","last_unstale":"2024-09-12T02:34:07.347370+0000","last_undegraded":"2024-09-12T02:34:07.347370+0000","last_fullsized":"2024-09-12T02:34:07.347370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896103+0000","last_change":"2024-09-12T02:34:00.053362+0000","last_active":"2024-09-12T02:34:07.896103+0000","last_peered":"2024-09-12T02:34:07.896103+0000","last_clean":"2024-09-12T02:34:07.896103+0000","last_became_active":"2024-09-12T02:34:00.053065+0000","last_became_peered":"2024-09-12T02:34:00.053065+0000","last_unstale":"2024-09-12T02:34:07.896103+0000","last_undegraded":"2024-09-12T02:34:07.896103+0000","last_fullsized":"2024-09-12T02:34:07.896103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562161+0000","last_change":"2024-09-12T02:34:05.078084+0000","last_active":"2024-09-12T02:34:08.562161+0000","last_peered":"2024-09-12T02:34:08.562161+0000","last_clean":"2024-09-12T02:34:08.562161+0000","last_became_active":"2024-09-12T02:34:05.077651+0000","last_became_peered":"2024-09-12T02:34:05.077651+0000","last_unstale":"2024-09-12T02:34:08.562161+0000","last_undegraded":"2024-09-12T02:34:08.562161+0000","last_fullsized":"2024-09-12T02:34:08.562161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:12.453888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896027+0000","last_change":"2024-09-12T02:34:01.069626+0000","last_active":"2024-09-12T02:34:07.896027+0000","last_peered":"2024-09-12T02:34:07.896027+0000","last_clean":"2024-09-12T02:34:07.896027+0000","last_became_active":"2024-09-12T02:34:01.069377+0000","last_became_peered":"2024-09-12T02:34:01.069377+0000","last_unstale":"2024-09-12T02:34:07.896027+0000","last_undegraded":"2024-09-12T02:34:07.896027+0000","last_fullsized":"2024-09-12T02:34:07.896027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:00.054287+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:00.054015+0000","last_became_peered":"2024-09-12T02:34:00.054015+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562172+0000","last_change":"2024-09-12T02:34:05.662260+0000","last_active":"2024-09-12T02:34:08.562172+0000","last_peered":"2024-09-12T02:34:08.562172+0000","last_clean":"2024-09-12T02:34:08.562172+0000","last_became_active":"2024-09-12T02:34:05.662024+0000","last_became_peered":"2024-09-12T02:34:05.662024+0000","last_unstale":"2024-09-12T02:34:08.562172+0000","last_undegraded":"2024-09-12T02:34:08.562172+0000","last_fullsized":"2024-09-12T02:34:08.562172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:58.165661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347329+0000","last_change":"2024-09-12T02:34:05.659237+0000","last_active":"2024-09-12T02:34:07.347329+0000","last_peered":"2024-09-12T02:34:07.347329+0000","last_clean":"2024-09-12T02:34:07.347329+0000","last_became_active":"2024-09-12T02:34:05.658549+0000","last_became_peered":"2024-09-12T02:34:05.658549+0000","last_unstale":"2024-09-12T02:34:07.347329+0000","last_undegraded":"2024-09-12T02:34:07.347329+0000","last_fullsized":"2024-09-12T02:34:07.347329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265465+0000","last_change":"2024-09-12T02:34:01.053018+0000","last_active":"2024-09-12T02:34:07.265465+0000","last_peered":"2024-09-12T02:34:07.265465+0000","last_clean":"2024-09-12T02:34:07.265465+0000","last_became_active":"2024-09-12T02:34:01.052640+0000","last_became_peered":"2024-09-12T02:34:01.052640+0000","last_unstale":"2024-09-12T02:34:07.265465+0000","last_undegraded":"2024-09-12T02:34:07.265465+0000","last_fullsized":"2024-09-12T02:34:07.265465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895717+0000","last_change":"2024-09-12T02:34:00.059071+0000","last_active":"2024-09-12T02:34:07.895717+0000","last_peered":"2024-09-12T02:34:07.895717+0000","last_clean":"2024-09-12T02:34:07.895717+0000","last_became_active":"2024-09-12T02:34:00.058712+0000","last_became_peered":"2024-09-12T02:34:00.058712+0000","last_unstale":"2024-09-12T02:34:07.895717+0000","last_undegraded":"2024-09-12T02:34:07.895717+0000","last_fullsized":"2024-09-12T02:34:07.895717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:05.078933+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:05.078471+0000","last_became_peered":"2024-09-12T02:34:05.078471+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562145+0000","last_change":"2024-09-12T02:34:01.062159+0000","last_active":"2024-09-12T02:34:08.562145+0000","last_peered":"2024-09-12T02:34:08.562145+0000","last_clean":"2024-09-12T02:34:08.562145+0000","last_became_active":"2024-09-12T02:34:01.061853+0000","last_became_peered":"2024-09-12T02:34:01.061853+0000","last_unstale":"2024-09-12T02:34:08.562145+0000","last_undegraded":"2024-09-12T02:34:08.562145+0000","last_fullsized":"2024-09-12T02:34:08.562145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:30.820938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561699+0000","last_change":"2024-09-12T02:34:00.059938+0000","last_active":"2024-09-12T02:34:08.561699+0000","last_peered":"2024-09-12T02:34:08.561699+0000","last_clean":"2024-09-12T02:34:08.561699+0000","last_became_active":"2024-09-12T02:34:00.059625+0000","last_became_peered":"2024-09-12T02:34:00.059625+0000","last_unstale":"2024-09-12T02:34:08.561699+0000","last_undegraded":"2024-09-12T02:34:08.561699+0000","last_fullsized":"2024-09-12T02:34:08.561699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:40.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094779+0000","last_change":"2024-09-12T02:34:00.048853+0000","last_active":"2024-09-12T02:34:07.094779+0000","last_peered":"2024-09-12T02:34:07.094779+0000","last_clean":"2024-09-12T02:34:07.094779+0000","last_became_active":"2024-09-12T02:34:00.048563+0000","last_became_peered":"2024-09-12T02:34:00.048563+0000","last_unstale":"2024-09-12T02:34:07.094779+0000","last_undegraded":"2024-09-12T02:34:07.094779+0000","last_fullsized":"2024-09-12T02:34:07.094779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.056880+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.056573+0000","last_became_peered":"2024-09-12T02:34:01.056573+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090610+0000","last_change":"2024-09-12T02:34:05.079707+0000","last_active":"2024-09-12T02:34:07.090610+0000","last_peered":"2024-09-12T02:34:07.090610+0000","last_clean":"2024-09-12T02:34:07.090610+0000","last_became_active":"2024-09-12T02:34:05.079349+0000","last_became_peered":"2024-09-12T02:34:05.079349+0000","last_unstale":"2024-09-12T02:34:07.090610+0000","last_undegraded":"2024-09-12T02:34:07.090610+0000","last_fullsized":"2024-09-12T02:34:07.090610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:17.011167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562431+0000","last_change":"2024-09-12T02:34:00.057281+0000","last_active":"2024-09-12T02:34:08.562431+0000","last_peered":"2024-09-12T02:34:08.562431+0000","last_clean":"2024-09-12T02:34:08.562431+0000","last_became_active":"2024-09-12T02:34:00.057004+0000","last_became_peered":"2024-09-12T02:34:00.057004+0000","last_unstale":"2024-09-12T02:34:08.562431+0000","last_undegraded":"2024-09-12T02:34:08.562431+0000","last_fullsized":"2024-09-12T02:34:08.562431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:23.045646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094064+0000","last_change":"2024-09-12T02:34:01.056167+0000","last_active":"2024-09-12T02:34:07.094064+0000","last_peered":"2024-09-12T02:34:07.094064+0000","last_clean":"2024-09-12T02:34:07.094064+0000","last_became_active":"2024-09-12T02:34:01.055914+0000","last_became_peered":"2024-09-12T02:34:01.055914+0000","last_unstale":"2024-09-12T02:34:07.094064+0000","last_undegraded":"2024-09-12T02:34:07.094064+0000","last_fullsized":"2024-09-12T02:34:07.094064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:06.967072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562579+0000","last_change":"2024-09-12T02:34:05.078328+0000","last_active":"2024-09-12T02:34:08.562579+0000","last_peered":"2024-09-12T02:34:08.562579+0000","last_clean":"2024-09-12T02:34:08.562579+0000","last_became_active":"2024-09-12T02:34:05.077613+0000","last_became_peered":"2024-09-12T02:34:05.077613+0000","last_unstale":"2024-09-12T02:34:08.562579+0000","last_undegraded":"2024-09-12T02:34:08.562579+0000","last_fullsized":"2024-09-12T02:34:08.562579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.567364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093915+0000","last_change":"2024-09-12T02:34:01.061088+0000","last_active":"2024-09-12T02:34:07.093915+0000","last_peered":"2024-09-12T02:34:07.093915+0000","last_clean":"2024-09-12T02:34:07.093915+0000","last_became_active":"2024-09-12T02:34:01.060388+0000","last_became_peered":"2024-09-12T02:34:01.060388+0000","last_unstale":"2024-09-12T02:34:07.093915+0000","last_undegraded":"2024-09-12T02:34:07.093915+0000","last_fullsized":"2024-09-12T02:34:07.093915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090261+0000","last_change":"2024-09-12T02:34:01.057775+0000","last_active":"2024-09-12T02:34:07.090261+0000","last_peered":"2024-09-12T02:34:07.090261+0000","last_clean":"2024-09-12T02:34:07.090261+0000","last_became_active":"2024-09-12T02:34:01.057444+0000","last_became_peered":"2024-09-12T02:34:01.057444+0000","last_unstale":"2024-09-12T02:34:07.090261+0000","last_undegraded":"2024-09-12T02:34:07.090261+0000","last_fullsized":"2024-09-12T02:34:07.090261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:59.156424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895959+0000","last_change":"2024-09-12T02:34:01.064983+0000","last_active":"2024-09-12T02:34:07.895959+0000","last_peered":"2024-09-12T02:34:07.895959+0000","last_clean":"2024-09-12T02:34:07.895959+0000","last_became_active":"2024-09-12T02:34:01.064526+0000","last_became_peered":"2024-09-12T02:34:01.064526+0000","last_unstale":"2024-09-12T02:34:07.895959+0000","last_undegraded":"2024-09-12T02:34:07.895959+0000","last_fullsized":"2024-09-12T02:34:07.895959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.055170+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.054896+0000","last_became_peered":"2024-09-12T02:34:01.054896+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562609+0000","last_change":"2024-09-12T02:34:01.058376+0000","last_active":"2024-09-12T02:34:08.562609+0000","last_peered":"2024-09-12T02:34:08.562609+0000","last_clean":"2024-09-12T02:34:08.562609+0000","last_became_active":"2024-09-12T02:34:01.058094+0000","last_became_peered":"2024-09-12T02:34:01.058094+0000","last_unstale":"2024-09-12T02:34:08.562609+0000","last_undegraded":"2024-09-12T02:34:08.562609+0000","last_fullsized":"2024-09-12T02:34:08.562609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:23.542579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.049857+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049533+0000","last_became_peered":"2024-09-12T02:34:01.049533+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095094+0000","last_change":"2024-09-12T02:34:01.059501+0000","last_active":"2024-09-12T02:34:07.095094+0000","last_peered":"2024-09-12T02:34:07.095094+0000","last_clean":"2024-09-12T02:34:07.095094+0000","last_became_active":"2024-09-12T02:34:01.059225+0000","last_became_peered":"2024-09-12T02:34:01.059225+0000","last_unstale":"2024-09-12T02:34:07.095094+0000","last_undegraded":"2024-09-12T02:34:07.095094+0000","last_fullsized":"2024-09-12T02:34:07.095094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562804+0000","last_change":"2024-09-12T02:34:01.055984+0000","last_active":"2024-09-12T02:34:08.562804+0000","last_peered":"2024-09-12T02:34:08.562804+0000","last_clean":"2024-09-12T02:34:08.562804+0000","last_became_active":"2024-09-12T02:34:01.055717+0000","last_became_peered":"2024-09-12T02:34:01.055717+0000","last_unstale":"2024-09-12T02:34:08.562804+0000","last_undegraded":"2024-09-12T02:34:08.562804+0000","last_fullsized":"2024-09-12T02:34:08.562804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895650+0000","last_change":"2024-09-12T02:34:01.065533+0000","last_active":"2024-09-12T02:34:07.895650+0000","last_peered":"2024-09-12T02:34:07.895650+0000","last_clean":"2024-09-12T02:34:07.895650+0000","last_became_active":"2024-09-12T02:34:01.065247+0000","last_became_peered":"2024-09-12T02:34:01.065247+0000","last_unstale":"2024-09-12T02:34:07.895650+0000","last_undegraded":"2024-09-12T02:34:07.895650+0000","last_fullsized":"2024-09-12T02:34:07.895650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:40.545417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562279+0000","last_change":"2024-09-12T02:34:01.056565+0000","last_active":"2024-09-12T02:34:08.562279+0000","last_peered":"2024-09-12T02:34:08.562279+0000","last_clean":"2024-09-12T02:34:08.562279+0000","last_became_active":"2024-09-12T02:34:01.056227+0000","last_became_peered":"2024-09-12T02:34:01.056227+0000","last_unstale":"2024-09-12T02:34:08.562279+0000","last_undegraded":"2024-09-12T02:34:08.562279+0000","last_fullsized":"2024-09-12T02:34:08.562279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:47.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895752+0000","last_change":"2024-09-12T02:34:01.070313+0000","last_active":"2024-09-12T02:34:07.895752+0000","last_peered":"2024-09-12T02:34:07.895752+0000","last_clean":"2024-09-12T02:34:07.895752+0000","last_became_active":"2024-09-12T02:34:01.070031+0000","last_became_peered":"2024-09-12T02:34:01.070031+0000","last_unstale":"2024-09-12T02:34:07.895752+0000","last_undegraded":"2024-09-12T02:34:07.895752+0000","last_fullsized":"2024-09-12T02:34:07.895752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:59.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347244+0000","last_change":"2024-09-12T02:34:01.060012+0000","last_active":"2024-09-12T02:34:07.347244+0000","last_peered":"2024-09-12T02:34:07.347244+0000","last_clean":"2024-09-12T02:34:07.347244+0000","last_became_active":"2024-09-12T02:34:01.059756+0000","last_became_peered":"2024-09-12T02:34:01.059756+0000","last_unstale":"2024-09-12T02:34:07.347244+0000","last_undegraded":"2024-09-12T02:34:07.347244+0000","last_fullsized":"2024-09-12T02:34:07.347244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.654168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094908+0000","last_change":"2024-09-12T02:34:01.056798+0000","last_active":"2024-09-12T02:34:07.094908+0000","last_peered":"2024-09-12T02:34:07.094908+0000","last_clean":"2024-09-12T02:34:07.094908+0000","last_became_active":"2024-09-12T02:34:01.056523+0000","last_became_peered":"2024-09-12T02:34:01.056523+0000","last_unstale":"2024-09-12T02:34:07.094908+0000","last_undegraded":"2024-09-12T02:34:07.094908+0000","last_fullsized":"2024-09-12T02:34:07.094908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836766+0000","last_change":"2024-09-12T02:34:01.069679+0000","last_active":"2024-09-12T02:34:08.836766+0000","last_peered":"2024-09-12T02:34:08.836766+0000","last_clean":"2024-09-12T02:34:08.836766+0000","last_became_active":"2024-09-12T02:34:01.069397+0000","last_became_peered":"2024-09-12T02:34:01.069397+0000","last_unstale":"2024-09-12T02:34:08.836766+0000","last_undegraded":"2024-09-12T02:34:08.836766+0000","last_fullsized":"2024-09-12T02:34:08.836766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:08.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090422+0000","last_change":"2024-09-12T02:34:01.054994+0000","last_active":"2024-09-12T02:34:07.090422+0000","last_peered":"2024-09-12T02:34:07.090422+0000","last_clean":"2024-09-12T02:34:07.090422+0000","last_became_active":"2024-09-12T02:34:01.054724+0000","last_became_peered":"2024-09-12T02:34:01.054724+0000","last_unstale":"2024-09-12T02:34:07.090422+0000","last_undegraded":"2024-09-12T02:34:07.090422+0000","last_fullsized":"2024-09-12T02:34:07.090422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:34.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896338+0000","last_change":"2024-09-12T02:34:01.076336+0000","last_active":"2024-09-12T02:34:07.896338+0000","last_peered":"2024-09-12T02:34:07.896338+0000","last_clean":"2024-09-12T02:34:07.896338+0000","last_became_active":"2024-09-12T02:34:01.075961+0000","last_became_peered":"2024-09-12T02:34:01.075961+0000","last_unstale":"2024-09-12T02:34:07.896338+0000","last_undegraded":"2024-09-12T02:34:07.896338+0000","last_fullsized":"2024-09-12T02:34:07.896338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895531+0000","last_change":"2024-09-12T02:34:01.067021+0000","last_active":"2024-09-12T02:34:07.895531+0000","last_peered":"2024-09-12T02:34:07.895531+0000","last_clean":"2024-09-12T02:34:07.895531+0000","last_became_active":"2024-09-12T02:34:01.065834+0000","last_became_peered":"2024-09-12T02:34:01.065834+0000","last_unstale":"2024-09-12T02:34:07.895531+0000","last_undegraded":"2024-09-12T02:34:07.895531+0000","last_fullsized":"2024-09-12T02:34:07.895531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265540+0000","last_change":"2024-09-12T02:34:01.052768+0000","last_active":"2024-09-12T02:34:07.265540+0000","last_peered":"2024-09-12T02:34:07.265540+0000","last_clean":"2024-09-12T02:34:07.265540+0000","last_became_active":"2024-09-12T02:34:01.052482+0000","last_became_peered":"2024-09-12T02:34:01.052482+0000","last_unstale":"2024-09-12T02:34:07.265540+0000","last_undegraded":"2024-09-12T02:34:07.265540+0000","last_fullsized":"2024-09-12T02:34:07.265540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347203+0000","last_change":"2024-09-12T02:34:01.055910+0000","last_active":"2024-09-12T02:34:07.347203+0000","last_peered":"2024-09-12T02:34:07.347203+0000","last_clean":"2024-09-12T02:34:07.347203+0000","last_became_active":"2024-09-12T02:34:01.055652+0000","last_became_peered":"2024-09-12T02:34:01.055652+0000","last_unstale":"2024-09-12T02:34:07.347203+0000","last_undegraded":"2024-09-12T02:34:07.347203+0000","last_fullsized":"2024-09-12T02:34:07.347203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:30.649532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562369+0000","last_change":"2024-09-12T02:34:01.061023+0000","last_active":"2024-09-12T02:34:08.562369+0000","last_peered":"2024-09-12T02:34:08.562369+0000","last_clean":"2024-09-12T02:34:08.562369+0000","last_became_active":"2024-09-12T02:34:01.060672+0000","last_became_peered":"2024-09-12T02:34:01.060672+0000","last_unstale":"2024-09-12T02:34:08.562369+0000","last_undegraded":"2024-09-12T02:34:08.562369+0000","last_fullsized":"2024-09-12T02:34:08.562369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.491024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095250+0000","last_change":"2024-09-12T02:34:01.061215+0000","last_active":"2024-09-12T02:34:07.095250+0000","last_peered":"2024-09-12T02:34:07.095250+0000","last_clean":"2024-09-12T02:34:07.095250+0000","last_became_active":"2024-09-12T02:34:01.060951+0000","last_became_peered":"2024-09-12T02:34:01.060951+0000","last_unstale":"2024-09-12T02:34:07.095250+0000","last_undegraded":"2024-09-12T02:34:07.095250+0000","last_fullsized":"2024-09-12T02:34:07.095250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:13.069032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095546+0000","last_change":"2024-09-12T02:34:01.070066+0000","last_active":"2024-09-12T02:34:07.095546+0000","last_peered":"2024-09-12T02:34:07.095546+0000","last_clean":"2024-09-12T02:34:07.095546+0000","last_became_active":"2024-09-12T02:34:01.069783+0000","last_became_peered":"2024-09-12T02:34:01.069783+0000","last_unstale":"2024-09-12T02:34:07.095546+0000","last_undegraded":"2024-09-12T02:34:07.095546+0000","last_fullsized":"2024-09-12T02:34:07.095546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094984+0000","last_change":"2024-09-12T02:34:01.070083+0000","last_active":"2024-09-12T02:34:07.094984+0000","last_peered":"2024-09-12T02:34:07.094984+0000","last_clean":"2024-09-12T02:34:07.094984+0000","last_became_active":"2024-09-12T02:34:01.069808+0000","last_became_peered":"2024-09-12T02:34:01.069808+0000","last_unstale":"2024-09-12T02:34:07.094984+0000","last_undegraded":"2024-09-12T02:34:07.094984+0000","last_fullsized":"2024-09-12T02:34:07.094984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836872+0000","last_change":"2024-09-12T02:34:01.074865+0000","last_active":"2024-09-12T02:34:08.836872+0000","last_peered":"2024-09-12T02:34:08.836872+0000","last_clean":"2024-09-12T02:34:08.836872+0000","last_became_active":"2024-09-12T02:34:01.074473+0000","last_became_peered":"2024-09-12T02:34:01.074473+0000","last_unstale":"2024-09-12T02:34:08.836872+0000","last_undegraded":"2024-09-12T02:34:08.836872+0000","last_fullsized":"2024-09-12T02:34:08.836872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:21.843182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562043+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:08.562043+0000","last_peered":"2024-09-12T02:34:08.562043+0000","last_clean":"2024-09-12T02:34:08.562043+0000","last_became_active":"2024-09-12T02:34:01.067024+0000","last_became_peered":"2024-09-12T02:34:01.067024+0000","last_unstale":"2024-09-12T02:34:08.562043+0000","last_undegraded":"2024-09-12T02:34:08.562043+0000","last_fullsized":"2024-09-12T02:34:08.562043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:56.143361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836303+0000","last_change":"2024-09-12T02:34:01.058244+0000","last_active":"2024-09-12T02:34:08.836303+0000","last_peered":"2024-09-12T02:34:08.836303+0000","last_clean":"2024-09-12T02:34:08.836303+0000","last_became_active":"2024-09-12T02:34:01.057968+0000","last_became_peered":"2024-09-12T02:34:01.057968+0000","last_unstale":"2024-09-12T02:34:08.836303+0000","last_undegraded":"2024-09-12T02:34:08.836303+0000","last_fullsized":"2024-09-12T02:34:08.836303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895748+0000","last_change":"2024-09-12T02:34:01.067464+0000","last_active":"2024-09-12T02:34:07.895748+0000","last_peered":"2024-09-12T02:34:07.895748+0000","last_clean":"2024-09-12T02:34:07.895748+0000","last_became_active":"2024-09-12T02:34:01.065862+0000","last_became_peered":"2024-09-12T02:34:01.065862+0000","last_unstale":"2024-09-12T02:34:07.895748+0000","last_undegraded":"2024-09-12T02:34:07.895748+0000","last_fullsized":"2024-09-12T02:34:07.895748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836442+0000","last_change":"2024-09-12T02:34:01.068831+0000","last_active":"2024-09-12T02:34:08.836442+0000","last_peered":"2024-09-12T02:34:08.836442+0000","last_clean":"2024-09-12T02:34:08.836442+0000","last_became_active":"2024-09-12T02:34:01.066724+0000","last_became_peered":"2024-09-12T02:34:01.066724+0000","last_unstale":"2024-09-12T02:34:08.836442+0000","last_undegraded":"2024-09-12T02:34:08.836442+0000","last_fullsized":"2024-09-12T02:34:08.836442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895852+0000","last_change":"2024-09-12T02:34:01.065590+0000","last_active":"2024-09-12T02:34:07.895852+0000","last_peered":"2024-09-12T02:34:07.895852+0000","last_clean":"2024-09-12T02:34:07.895852+0000","last_became_active":"2024-09-12T02:34:01.065308+0000","last_became_peered":"2024-09-12T02:34:01.065308+0000","last_unstale":"2024-09-12T02:34:07.895852+0000","last_undegraded":"2024-09-12T02:34:07.895852+0000","last_fullsized":"2024-09-12T02:34:07.895852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347223+0000","last_change":"2024-09-12T02:34:01.056168+0000","last_active":"2024-09-12T02:34:07.347223+0000","last_peered":"2024-09-12T02:34:07.347223+0000","last_clean":"2024-09-12T02:34:07.347223+0000","last_became_active":"2024-09-12T02:34:01.055731+0000","last_became_peered":"2024-09-12T02:34:01.055731+0000","last_unstale":"2024-09-12T02:34:07.347223+0000","last_undegraded":"2024-09-12T02:34:07.347223+0000","last_fullsized":"2024-09-12T02:34:07.347223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266139+0000","last_change":"2024-09-12T02:34:01.060961+0000","last_active":"2024-09-12T02:34:07.266139+0000","last_peered":"2024-09-12T02:34:07.266139+0000","last_clean":"2024-09-12T02:34:07.266139+0000","last_became_active":"2024-09-12T02:34:01.060669+0000","last_became_peered":"2024-09-12T02:34:01.060669+0000","last_unstale":"2024-09-12T02:34:07.266139+0000","last_undegraded":"2024-09-12T02:34:07.266139+0000","last_fullsized":"2024-09-12T02:34:07.266139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836765+0000","last_change":"2024-09-12T02:34:01.074156+0000","last_active":"2024-09-12T02:34:08.836765+0000","last_peered":"2024-09-12T02:34:08.836765+0000","last_clean":"2024-09-12T02:34:08.836765+0000","last_became_active":"2024-09-12T02:34:01.073860+0000","last_became_peered":"2024-09-12T02:34:01.073860+0000","last_unstale":"2024-09-12T02:34:08.836765+0000","last_undegraded":"2024-09-12T02:34:08.836765+0000","last_fullsized":"2024-09-12T02:34:08.836765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476746,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":704005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476745,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":113181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":113215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":704061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":113055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:21.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:21.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.320+0000 7f76ceb86640 1 Processor -- start 2024-09-12T02:34:21.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.320+0000 7f76ceb86640 1 -- start start 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76ceb86640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76c806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76ceb86640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c80d2700 con 0x7f76c80d4fd0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76ceb86640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c80cedb0 con 0x7f76c80cfcc0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76ceb86640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76c80cf090 con 0x7f76c815e760 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76c7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f76c80d4fd0 0x7f76c80cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49186/0 (socket says 172.21.15.119:49186) 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76c7fff640 1 -- 172.21.15.119:0/3333442088 learned_addr learned my addr 172.21.15.119:0/3333442088 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219071626 0 0) 0x7f76bc001290 con 0x7f76c80d4fd0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76c806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.321+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b0003520 con 0x7f76c80d4fd0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3509447275 0 0) 0x7f76b0003520 con 0x7f76c80d4fd0 2024-09-12T02:34:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 msgr2=0x7f76c806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76c806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 >> v1:172.21.15.153:6789/0 conn(0x7f76c80cfcc0 legacy=0x7f76c80d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c80b3c80 con 0x7f76c80d4fd0 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f76bc0019e0 con 0x7f76c80d4fd0 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76c806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 >> v1:172.21.15.119:6789/0 conn(0x7f76c80d4fd0 legacy=0x7f76c80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76b0004800 0x7f76b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80cf090 con 0x7f76b00039e0 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00054e0 con 0x7f76b0004800 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76b000bf00 con 0x7f76c815e760 2024-09-12T02:34:21.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76c7fff640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76b0004800 0x7f76b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cd123640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 -- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 msgr2=0x7f76b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 -- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76b0004800 msgr2=0x7f76b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76b0004800 0x7f76b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cc922640 1 -- 172.21.15.119:0/3333442088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b0003520 con 0x7f76b00039e0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.322+0000 7f76cd123640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c815e760 0x7f76b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.323+0000 7f76cc922640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76b0003e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f76b80098a0 tx=0x7f76b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc07328408f1facf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.323+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b800f040 con 0x7f76b00039e0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.323+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b802ace0 con 0x7f76b00039e0 2024-09-12T02:34:21.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.323+0000 7f76c77fe640 1 -- 172.21.15.119:0/3333442088 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004250 con 0x7f76b00039e0 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 -- 172.21.15.119:0/3333442088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 msgr2=0x7f76b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 --2- 172.21.15.119:0/3333442088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76b0003e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f76b80098a0 tx=0x7f76b0005830 comp rx=0 tx=0).stop 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76cd123640 1 -- 172.21.15.119:0/3333442088 reap_dead start 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 -- 172.21.15.119:0/3333442088 shutdown_connections 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 -- 172.21.15.119:0/3333442088 >> 172.21.15.119:0/3333442088 conn(0x7f76c808bfc0 msgr2=0x7f76c80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 -- 172.21.15.119:0/3333442088 shutdown_connections 2024-09-12T02:34:21.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.324+0000 7f76ceb86640 1 -- 172.21.15.119:0/3333442088 wait complete. 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.325+0000 7f76ceb86640 1 Processor -- start 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.325+0000 7f76ceb86640 1 -- start start 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80ce2b0 0x7f76c80b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c80cb900 0x7f76c80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76c806cdd0 con 0x7f76b00039e0 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80b38a0 con 0x7f76c80ce2b0 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76ceb86640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76c806cf50 con 0x7f76c80cb900 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56684/0 (socket says 172.21.15.119:56684) 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 -- 172.21.15.119:0/833422025 learned_addr learned my addr 172.21.15.119:0/833422025 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76c7fff640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80ce2b0 0x7f76c80b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cd123640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c80cb900 0x7f76c80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 -- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c80cb900 msgr2=0x7f76c80cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c80cb900 0x7f76c80cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 -- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80ce2b0 msgr2=0x7f76c80b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80ce2b0 0x7f76c80b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 -- 172.21.15.119:0/833422025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c815f120 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.326+0000 7f76cc922640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76b80099c0 tx=0x7f76b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.327+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8041070 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.327+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b800f000 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.327+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c815f400 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.327+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b80044d0 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.327+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c815fca0 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.328+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c80b6d20 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.328+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76b8044070 con 0x7f76b00039e0 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.328+0000 7f76c57fa640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 0x7f76b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.329+0000 7f76c7fff640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 0x7f76b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.329+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f76b80ab750 con 0x7f76b00039e0 2024-09-12T02:34:21.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.329+0000 7f76c7fff640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 0x7f76b406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0011d0 tx=0x7f76bc0013d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.333+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76b8079770 con 0x7f76b00039e0 2024-09-12T02:34:21.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.493+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76c8073710 con 0x7f76b406be60 2024-09-12T02:34:21.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.501+0000 7f76c57fa640 1 -- 172.21.15.119:0/833422025 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f76c8073710 con 0x7f76b406be60 2024-09-12T02:34:21.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:21.507 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:21.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 msgr2=0x7f76b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 0x7f76b406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0011d0 tx=0x7f76bc0013d0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 msgr2=0x7f76c815eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76b80099c0 tx=0x7f76b8004730 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 shutdown_connections 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f76b406be60 0x7f76b406e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76c80cb900 0x7f76c80cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80ce2b0 0x7f76c80b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 --2- 172.21.15.119:0/833422025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b00039e0 0x7f76c815eb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 >> 172.21.15.119:0/833422025 conn(0x7f76c808bfc0 msgr2=0x7f76c80b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 shutdown_connections 2024-09-12T02:34:21.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.504+0000 7f76ceb86640 1 -- 172.21.15.119:0/833422025 wait complete. 2024-09-12T02:34:21.515 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-12T02:34:21.183021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219636,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755084,"statfs":{"total":773094113280,"available":772869206016,"internally_reserved":0,"allocated":3481600,"data_stored":2094460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003360"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347397+0000","last_change":"2024-09-12T02:34:00.057067+0000","last_active":"2024-09-12T02:34:07.347397+0000","last_peered":"2024-09-12T02:34:07.347397+0000","last_clean":"2024-09-12T02:34:07.347397+0000","last_became_active":"2024-09-12T02:34:00.056766+0000","last_became_peered":"2024-09-12T02:34:00.056766+0000","last_unstale":"2024-09-12T02:34:07.347397+0000","last_undegraded":"2024-09-12T02:34:07.347397+0000","last_fullsized":"2024-09-12T02:34:07.347397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:36.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562594+0000","last_change":"2024-09-12T02:34:01.061517+0000","last_active":"2024-09-12T02:34:08.562594+0000","last_peered":"2024-09-12T02:34:08.562594+0000","last_clean":"2024-09-12T02:34:08.562594+0000","last_became_active":"2024-09-12T02:34:01.061120+0000","last_became_peered":"2024-09-12T02:34:01.061120+0000","last_unstale":"2024-09-12T02:34:08.562594+0000","last_undegraded":"2024-09-12T02:34:08.562594+0000","last_fullsized":"2024-09-12T02:34:08.562594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:18.386298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562151+0000","last_change":"2024-09-12T02:34:05.658529+0000","last_active":"2024-09-12T02:34:08.562151+0000","last_peered":"2024-09-12T02:34:08.562151+0000","last_clean":"2024-09-12T02:34:08.562151+0000","last_became_active":"2024-09-12T02:34:05.658141+0000","last_became_peered":"2024-09-12T02:34:05.658141+0000","last_unstale":"2024-09-12T02:34:08.562151+0000","last_undegraded":"2024-09-12T02:34:08.562151+0000","last_fullsized":"2024-09-12T02:34:08.562151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:35.123440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561735+0000","last_change":"2024-09-12T02:34:00.059738+0000","last_active":"2024-09-12T02:34:08.561735+0000","last_peered":"2024-09-12T02:34:08.561735+0000","last_clean":"2024-09-12T02:34:08.561735+0000","last_became_active":"2024-09-12T02:34:00.059507+0000","last_became_peered":"2024-09-12T02:34:00.059507+0000","last_unstale":"2024-09-12T02:34:08.561735+0000","last_undegraded":"2024-09-12T02:34:08.561735+0000","last_fullsized":"2024-09-12T02:34:08.561735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347277+0000","last_change":"2024-09-12T02:34:01.066517+0000","last_active":"2024-09-12T02:34:07.347277+0000","last_peered":"2024-09-12T02:34:07.347277+0000","last_clean":"2024-09-12T02:34:07.347277+0000","last_became_active":"2024-09-12T02:34:01.066244+0000","last_became_peered":"2024-09-12T02:34:01.066244+0000","last_unstale":"2024-09-12T02:34:07.347277+0000","last_undegraded":"2024-09-12T02:34:07.347277+0000","last_fullsized":"2024-09-12T02:34:07.347277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094181+0000","last_change":"2024-09-12T02:34:05.080417+0000","last_active":"2024-09-12T02:34:07.094181+0000","last_peered":"2024-09-12T02:34:07.094181+0000","last_clean":"2024-09-12T02:34:07.094181+0000","last_became_active":"2024-09-12T02:34:05.079990+0000","last_became_peered":"2024-09-12T02:34:05.079990+0000","last_unstale":"2024-09-12T02:34:07.094181+0000","last_undegraded":"2024-09-12T02:34:07.094181+0000","last_fullsized":"2024-09-12T02:34:07.094181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:13.003179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835917+0000","last_change":"2024-09-12T02:34:00.065442+0000","last_active":"2024-09-12T02:34:08.835917+0000","last_peered":"2024-09-12T02:34:08.835917+0000","last_clean":"2024-09-12T02:34:08.835917+0000","last_became_active":"2024-09-12T02:34:00.065146+0000","last_became_peered":"2024-09-12T02:34:00.065146+0000","last_unstale":"2024-09-12T02:34:08.835917+0000","last_undegraded":"2024-09-12T02:34:08.835917+0000","last_fullsized":"2024-09-12T02:34:08.835917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:05.525436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895899+0000","last_change":"2024-09-12T02:34:01.063766+0000","last_active":"2024-09-12T02:34:07.895899+0000","last_peered":"2024-09-12T02:34:07.895899+0000","last_clean":"2024-09-12T02:34:07.895899+0000","last_became_active":"2024-09-12T02:34:01.063502+0000","last_became_peered":"2024-09-12T02:34:01.063502+0000","last_unstale":"2024-09-12T02:34:07.895899+0000","last_undegraded":"2024-09-12T02:34:07.895899+0000","last_fullsized":"2024-09-12T02:34:07.895899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093971+0000","last_change":"2024-09-12T02:34:05.079431+0000","last_active":"2024-09-12T02:34:07.093971+0000","last_peered":"2024-09-12T02:34:07.093971+0000","last_clean":"2024-09-12T02:34:07.093971+0000","last_became_active":"2024-09-12T02:34:05.079067+0000","last_became_peered":"2024-09-12T02:34:05.079067+0000","last_unstale":"2024-09-12T02:34:07.093971+0000","last_undegraded":"2024-09-12T02:34:07.093971+0000","last_fullsized":"2024-09-12T02:34:07.093971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835848+0000","last_change":"2024-09-12T02:34:00.061054+0000","last_active":"2024-09-12T02:34:08.835848+0000","last_peered":"2024-09-12T02:34:08.835848+0000","last_clean":"2024-09-12T02:34:08.835848+0000","last_became_active":"2024-09-12T02:34:00.060797+0000","last_became_peered":"2024-09-12T02:34:00.060797+0000","last_unstale":"2024-09-12T02:34:08.835848+0000","last_undegraded":"2024-09-12T02:34:08.835848+0000","last_fullsized":"2024-09-12T02:34:08.835848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896093+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:07.896093+0000","last_peered":"2024-09-12T02:34:07.896093+0000","last_clean":"2024-09-12T02:34:07.896093+0000","last_became_active":"2024-09-12T02:34:01.067112+0000","last_became_peered":"2024-09-12T02:34:01.067112+0000","last_unstale":"2024-09-12T02:34:07.896093+0000","last_undegraded":"2024-09-12T02:34:07.896093+0000","last_fullsized":"2024-09-12T02:34:07.896093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093944+0000","last_change":"2024-09-12T02:34:05.077446+0000","last_active":"2024-09-12T02:34:07.093944+0000","last_peered":"2024-09-12T02:34:07.093944+0000","last_clean":"2024-09-12T02:34:07.093944+0000","last_became_active":"2024-09-12T02:34:05.077106+0000","last_became_peered":"2024-09-12T02:34:05.077106+0000","last_unstale":"2024-09-12T02:34:07.093944+0000","last_undegraded":"2024-09-12T02:34:07.093944+0000","last_fullsized":"2024-09-12T02:34:07.093944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094605+0000","last_change":"2024-09-12T02:34:01.056215+0000","last_active":"2024-09-12T02:34:07.094605+0000","last_peered":"2024-09-12T02:34:07.094605+0000","last_clean":"2024-09-12T02:34:07.094605+0000","last_became_active":"2024-09-12T02:34:01.055913+0000","last_became_peered":"2024-09-12T02:34:01.055913+0000","last_unstale":"2024-09-12T02:34:07.094605+0000","last_undegraded":"2024-09-12T02:34:07.094605+0000","last_fullsized":"2024-09-12T02:34:07.094605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835838+0000","last_change":"2024-09-12T02:34:00.058795+0000","last_active":"2024-09-12T02:34:08.835838+0000","last_peered":"2024-09-12T02:34:08.835838+0000","last_clean":"2024-09-12T02:34:08.835838+0000","last_became_active":"2024-09-12T02:34:00.058542+0000","last_became_peered":"2024-09-12T02:34:00.058542+0000","last_unstale":"2024-09-12T02:34:08.835838+0000","last_undegraded":"2024-09-12T02:34:08.835838+0000","last_fullsized":"2024-09-12T02:34:08.835838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095266+0000","last_change":"2024-09-12T02:34:05.081285+0000","last_active":"2024-09-12T02:34:07.095266+0000","last_peered":"2024-09-12T02:34:07.095266+0000","last_clean":"2024-09-12T02:34:07.095266+0000","last_became_active":"2024-09-12T02:34:05.080737+0000","last_became_peered":"2024-09-12T02:34:05.080737+0000","last_unstale":"2024-09-12T02:34:07.095266+0000","last_undegraded":"2024-09-12T02:34:07.095266+0000","last_fullsized":"2024-09-12T02:34:07.095266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562380+0000","last_change":"2024-09-12T02:34:01.058977+0000","last_active":"2024-09-12T02:34:08.562380+0000","last_peered":"2024-09-12T02:34:08.562380+0000","last_clean":"2024-09-12T02:34:08.562380+0000","last_became_active":"2024-09-12T02:34:01.058631+0000","last_became_peered":"2024-09-12T02:34:01.058631+0000","last_unstale":"2024-09-12T02:34:08.562380+0000","last_undegraded":"2024-09-12T02:34:08.562380+0000","last_fullsized":"2024-09-12T02:34:08.562380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:31.239556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265847+0000","last_change":"2024-09-12T02:34:00.058689+0000","last_active":"2024-09-12T02:34:07.265847+0000","last_peered":"2024-09-12T02:34:07.265847+0000","last_clean":"2024-09-12T02:34:07.265847+0000","last_became_active":"2024-09-12T02:34:00.058428+0000","last_became_peered":"2024-09-12T02:34:00.058428+0000","last_unstale":"2024-09-12T02:34:07.265847+0000","last_undegraded":"2024-09-12T02:34:07.265847+0000","last_fullsized":"2024-09-12T02:34:07.265847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095071+0000","last_change":"2024-09-12T02:34:05.080503+0000","last_active":"2024-09-12T02:34:07.095071+0000","last_peered":"2024-09-12T02:34:07.095071+0000","last_clean":"2024-09-12T02:34:07.095071+0000","last_became_active":"2024-09-12T02:34:05.080079+0000","last_became_peered":"2024-09-12T02:34:05.080079+0000","last_unstale":"2024-09-12T02:34:07.095071+0000","last_undegraded":"2024-09-12T02:34:07.095071+0000","last_fullsized":"2024-09-12T02:34:07.095071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562242+0000","last_change":"2024-09-12T02:34:01.050151+0000","last_active":"2024-09-12T02:34:08.562242+0000","last_peered":"2024-09-12T02:34:08.562242+0000","last_clean":"2024-09-12T02:34:08.562242+0000","last_became_active":"2024-09-12T02:34:01.049816+0000","last_became_peered":"2024-09-12T02:34:01.049816+0000","last_unstale":"2024-09-12T02:34:08.562242+0000","last_undegraded":"2024-09-12T02:34:08.562242+0000","last_fullsized":"2024-09-12T02:34:08.562242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:24.977490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265581+0000","last_change":"2024-09-12T02:34:00.056061+0000","last_active":"2024-09-12T02:34:07.265581+0000","last_peered":"2024-09-12T02:34:07.265581+0000","last_clean":"2024-09-12T02:34:07.265581+0000","last_became_active":"2024-09-12T02:34:00.055702+0000","last_became_peered":"2024-09-12T02:34:00.055702+0000","last_unstale":"2024-09-12T02:34:07.265581+0000","last_undegraded":"2024-09-12T02:34:07.265581+0000","last_fullsized":"2024-09-12T02:34:07.265581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266184+0000","last_change":"2024-09-12T02:34:05.658591+0000","last_active":"2024-09-12T02:34:07.266184+0000","last_peered":"2024-09-12T02:34:07.266184+0000","last_clean":"2024-09-12T02:34:07.266184+0000","last_became_active":"2024-09-12T02:34:05.658221+0000","last_became_peered":"2024-09-12T02:34:05.658221+0000","last_unstale":"2024-09-12T02:34:07.266184+0000","last_undegraded":"2024-09-12T02:34:07.266184+0000","last_fullsized":"2024-09-12T02:34:07.266184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095029+0000","last_change":"2024-09-12T02:34:01.063254+0000","last_active":"2024-09-12T02:34:07.095029+0000","last_peered":"2024-09-12T02:34:07.095029+0000","last_clean":"2024-09-12T02:34:07.095029+0000","last_became_active":"2024-09-12T02:34:01.062975+0000","last_became_peered":"2024-09-12T02:34:01.062975+0000","last_unstale":"2024-09-12T02:34:07.095029+0000","last_undegraded":"2024-09-12T02:34:07.095029+0000","last_fullsized":"2024-09-12T02:34:07.095029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:58.049718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835835+0000","last_change":"2024-09-12T02:34:00.060051+0000","last_active":"2024-09-12T02:34:08.835835+0000","last_peered":"2024-09-12T02:34:08.835835+0000","last_clean":"2024-09-12T02:34:08.835835+0000","last_became_active":"2024-09-12T02:34:00.059298+0000","last_became_peered":"2024-09-12T02:34:00.059298+0000","last_unstale":"2024-09-12T02:34:08.835835+0000","last_undegraded":"2024-09-12T02:34:08.835835+0000","last_fullsized":"2024-09-12T02:34:08.835835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094722+0000","last_change":"2024-09-12T02:34:05.080851+0000","last_active":"2024-09-12T02:34:07.094722+0000","last_peered":"2024-09-12T02:34:07.094722+0000","last_clean":"2024-09-12T02:34:07.094722+0000","last_became_active":"2024-09-12T02:34:05.080409+0000","last_became_peered":"2024-09-12T02:34:05.080409+0000","last_unstale":"2024-09-12T02:34:07.094722+0000","last_undegraded":"2024-09-12T02:34:07.094722+0000","last_fullsized":"2024-09-12T02:34:07.094722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347589+0000","last_change":"2024-09-12T02:34:01.052544+0000","last_active":"2024-09-12T02:34:07.347589+0000","last_peered":"2024-09-12T02:34:07.347589+0000","last_clean":"2024-09-12T02:34:07.347589+0000","last_became_active":"2024-09-12T02:34:01.052248+0000","last_became_peered":"2024-09-12T02:34:01.052248+0000","last_unstale":"2024-09-12T02:34:07.347589+0000","last_undegraded":"2024-09-12T02:34:07.347589+0000","last_fullsized":"2024-09-12T02:34:07.347589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095474+0000","last_change":"2024-09-12T02:34:00.056829+0000","last_active":"2024-09-12T02:34:07.095474+0000","last_peered":"2024-09-12T02:34:07.095474+0000","last_clean":"2024-09-12T02:34:07.095474+0000","last_became_active":"2024-09-12T02:34:00.056507+0000","last_became_peered":"2024-09-12T02:34:00.056507+0000","last_unstale":"2024-09-12T02:34:07.095474+0000","last_undegraded":"2024-09-12T02:34:07.095474+0000","last_fullsized":"2024-09-12T02:34:07.095474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094358+0000","last_change":"2024-09-12T02:34:05.658703+0000","last_active":"2024-09-12T02:34:07.094358+0000","last_peered":"2024-09-12T02:34:07.094358+0000","last_clean":"2024-09-12T02:34:07.094358+0000","last_became_active":"2024-09-12T02:34:05.658284+0000","last_became_peered":"2024-09-12T02:34:05.658284+0000","last_unstale":"2024-09-12T02:34:07.094358+0000","last_undegraded":"2024-09-12T02:34:07.094358+0000","last_fullsized":"2024-09-12T02:34:07.094358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562853+0000","last_change":"2024-09-12T02:34:01.062483+0000","last_active":"2024-09-12T02:34:08.562853+0000","last_peered":"2024-09-12T02:34:08.562853+0000","last_clean":"2024-09-12T02:34:08.562853+0000","last_became_active":"2024-09-12T02:34:01.062172+0000","last_became_peered":"2024-09-12T02:34:01.062172+0000","last_unstale":"2024-09-12T02:34:08.562853+0000","last_undegraded":"2024-09-12T02:34:08.562853+0000","last_fullsized":"2024-09-12T02:34:08.562853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:34.983530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266195+0000","last_change":"2024-09-12T02:34:00.052655+0000","last_active":"2024-09-12T02:34:07.266195+0000","last_peered":"2024-09-12T02:34:07.266195+0000","last_clean":"2024-09-12T02:34:07.266195+0000","last_became_active":"2024-09-12T02:34:00.051516+0000","last_became_peered":"2024-09-12T02:34:00.051516+0000","last_unstale":"2024-09-12T02:34:07.266195+0000","last_undegraded":"2024-09-12T02:34:07.266195+0000","last_fullsized":"2024-09-12T02:34:07.266195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562000+0000","last_change":"2024-09-12T02:34:05.658723+0000","last_active":"2024-09-12T02:34:08.562000+0000","last_peered":"2024-09-12T02:34:08.562000+0000","last_clean":"2024-09-12T02:34:08.562000+0000","last_became_active":"2024-09-12T02:34:05.658328+0000","last_became_peered":"2024-09-12T02:34:05.658328+0000","last_unstale":"2024-09-12T02:34:08.562000+0000","last_undegraded":"2024-09-12T02:34:08.562000+0000","last_fullsized":"2024-09-12T02:34:08.562000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.652938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.050206+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049932+0000","last_became_peered":"2024-09-12T02:34:01.049932+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835876+0000","last_change":"2024-09-12T02:34:00.060227+0000","last_active":"2024-09-12T02:34:08.835876+0000","last_peered":"2024-09-12T02:34:08.835876+0000","last_clean":"2024-09-12T02:34:08.835876+0000","last_became_active":"2024-09-12T02:34:00.059857+0000","last_became_peered":"2024-09-12T02:34:00.059857+0000","last_unstale":"2024-09-12T02:34:08.835876+0000","last_undegraded":"2024-09-12T02:34:08.835876+0000","last_fullsized":"2024-09-12T02:34:08.835876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:35.697987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347145+0000","last_change":"2024-09-12T02:34:05.656856+0000","last_active":"2024-09-12T02:34:07.347145+0000","last_peered":"2024-09-12T02:34:07.347145+0000","last_clean":"2024-09-12T02:34:07.347145+0000","last_became_active":"2024-09-12T02:34:05.656368+0000","last_became_peered":"2024-09-12T02:34:05.656368+0000","last_unstale":"2024-09-12T02:34:07.347145+0000","last_undegraded":"2024-09-12T02:34:07.347145+0000","last_fullsized":"2024-09-12T02:34:07.347145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896211+0000","last_change":"2024-09-12T02:34:01.064917+0000","last_active":"2024-09-12T02:34:07.896211+0000","last_peered":"2024-09-12T02:34:07.896211+0000","last_clean":"2024-09-12T02:34:07.896211+0000","last_became_active":"2024-09-12T02:34:01.064584+0000","last_became_peered":"2024-09-12T02:34:01.064584+0000","last_unstale":"2024-09-12T02:34:07.896211+0000","last_undegraded":"2024-09-12T02:34:07.896211+0000","last_fullsized":"2024-09-12T02:34:07.896211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266024+0000","last_change":"2024-09-12T02:34:00.058032+0000","last_active":"2024-09-12T02:34:07.266024+0000","last_peered":"2024-09-12T02:34:07.266024+0000","last_clean":"2024-09-12T02:34:07.266024+0000","last_became_active":"2024-09-12T02:34:00.057761+0000","last_became_peered":"2024-09-12T02:34:00.057761+0000","last_unstale":"2024-09-12T02:34:07.266024+0000","last_undegraded":"2024-09-12T02:34:07.266024+0000","last_fullsized":"2024-09-12T02:34:07.266024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265571+0000","last_change":"2024-09-12T02:34:05.084537+0000","last_active":"2024-09-12T02:34:07.265571+0000","last_peered":"2024-09-12T02:34:07.265571+0000","last_clean":"2024-09-12T02:34:07.265571+0000","last_became_active":"2024-09-12T02:34:05.084024+0000","last_became_peered":"2024-09-12T02:34:05.084024+0000","last_unstale":"2024-09-12T02:34:07.265571+0000","last_undegraded":"2024-09-12T02:34:07.265571+0000","last_fullsized":"2024-09-12T02:34:07.265571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095347+0000","last_change":"2024-09-12T02:34:01.062564+0000","last_active":"2024-09-12T02:34:07.095347+0000","last_peered":"2024-09-12T02:34:07.095347+0000","last_clean":"2024-09-12T02:34:07.095347+0000","last_became_active":"2024-09-12T02:34:01.062007+0000","last_became_peered":"2024-09-12T02:34:01.062007+0000","last_unstale":"2024-09-12T02:34:07.095347+0000","last_undegraded":"2024-09-12T02:34:07.095347+0000","last_fullsized":"2024-09-12T02:34:07.095347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:57.201089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896147+0000","last_change":"2024-09-12T02:34:00.057767+0000","last_active":"2024-09-12T02:34:07.896147+0000","last_peered":"2024-09-12T02:34:07.896147+0000","last_clean":"2024-09-12T02:34:07.896147+0000","last_became_active":"2024-09-12T02:34:00.057309+0000","last_became_peered":"2024-09-12T02:34:00.057309+0000","last_unstale":"2024-09-12T02:34:07.896147+0000","last_undegraded":"2024-09-12T02:34:07.896147+0000","last_fullsized":"2024-09-12T02:34:07.896147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265935+0000","last_change":"2024-09-12T02:34:05.080386+0000","last_active":"2024-09-12T02:34:07.265935+0000","last_peered":"2024-09-12T02:34:07.265935+0000","last_clean":"2024-09-12T02:34:07.265935+0000","last_became_active":"2024-09-12T02:34:05.079869+0000","last_became_peered":"2024-09-12T02:34:05.079869+0000","last_unstale":"2024-09-12T02:34:07.265935+0000","last_undegraded":"2024-09-12T02:34:07.265935+0000","last_fullsized":"2024-09-12T02:34:07.265935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265585+0000","last_change":"2024-09-12T02:34:01.048210+0000","last_active":"2024-09-12T02:34:07.265585+0000","last_peered":"2024-09-12T02:34:07.265585+0000","last_clean":"2024-09-12T02:34:07.265585+0000","last_became_active":"2024-09-12T02:34:01.047883+0000","last_became_peered":"2024-09-12T02:34:01.047883+0000","last_unstale":"2024-09-12T02:34:07.265585+0000","last_undegraded":"2024-09-12T02:34:07.265585+0000","last_fullsized":"2024-09-12T02:34:07.265585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090263+0000","last_change":"2024-09-12T02:34:00.052517+0000","last_active":"2024-09-12T02:34:07.090263+0000","last_peered":"2024-09-12T02:34:07.090263+0000","last_clean":"2024-09-12T02:34:07.090263+0000","last_became_active":"2024-09-12T02:34:00.052229+0000","last_became_peered":"2024-09-12T02:34:00.052229+0000","last_unstale":"2024-09-12T02:34:07.090263+0000","last_undegraded":"2024-09-12T02:34:07.090263+0000","last_fullsized":"2024-09-12T02:34:07.090263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:52.608734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266180+0000","last_change":"2024-09-12T02:34:05.079492+0000","last_active":"2024-09-12T02:34:07.266180+0000","last_peered":"2024-09-12T02:34:07.266180+0000","last_clean":"2024-09-12T02:34:07.266180+0000","last_became_active":"2024-09-12T02:34:05.079114+0000","last_became_peered":"2024-09-12T02:34:05.079114+0000","last_unstale":"2024-09-12T02:34:07.266180+0000","last_undegraded":"2024-09-12T02:34:07.266180+0000","last_fullsized":"2024-09-12T02:34:07.266180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.346986+0000","last_change":"2024-09-12T02:34:01.057070+0000","last_active":"2024-09-12T02:34:07.346986+0000","last_peered":"2024-09-12T02:34:07.346986+0000","last_clean":"2024-09-12T02:34:07.346986+0000","last_became_active":"2024-09-12T02:34:01.056658+0000","last_became_peered":"2024-09-12T02:34:01.056658+0000","last_unstale":"2024-09-12T02:34:07.346986+0000","last_undegraded":"2024-09-12T02:34:07.346986+0000","last_fullsized":"2024-09-12T02:34:07.346986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.216224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835827+0000","last_change":"2024-09-12T02:34:00.061960+0000","last_active":"2024-09-12T02:34:08.835827+0000","last_peered":"2024-09-12T02:34:08.835827+0000","last_clean":"2024-09-12T02:34:08.835827+0000","last_became_active":"2024-09-12T02:34:00.061710+0000","last_became_peered":"2024-09-12T02:34:00.061710+0000","last_unstale":"2024-09-12T02:34:08.835827+0000","last_undegraded":"2024-09-12T02:34:08.835827+0000","last_fullsized":"2024-09-12T02:34:08.835827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347500+0000","last_change":"2024-09-12T02:34:05.658955+0000","last_active":"2024-09-12T02:34:07.347500+0000","last_peered":"2024-09-12T02:34:07.347500+0000","last_clean":"2024-09-12T02:34:07.347500+0000","last_became_active":"2024-09-12T02:34:05.657958+0000","last_became_peered":"2024-09-12T02:34:05.657958+0000","last_unstale":"2024-09-12T02:34:07.347500+0000","last_undegraded":"2024-09-12T02:34:07.347500+0000","last_fullsized":"2024-09-12T02:34:07.347500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562253+0000","last_change":"2024-09-12T02:34:01.067308+0000","last_active":"2024-09-12T02:34:08.562253+0000","last_peered":"2024-09-12T02:34:08.562253+0000","last_clean":"2024-09-12T02:34:08.562253+0000","last_became_active":"2024-09-12T02:34:01.066973+0000","last_became_peered":"2024-09-12T02:34:01.066973+0000","last_unstale":"2024-09-12T02:34:08.562253+0000","last_undegraded":"2024-09-12T02:34:08.562253+0000","last_fullsized":"2024-09-12T02:34:08.562253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.656076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895930+0000","last_change":"2024-09-12T02:34:00.055611+0000","last_active":"2024-09-12T02:34:07.895930+0000","last_peered":"2024-09-12T02:34:07.895930+0000","last_clean":"2024-09-12T02:34:07.895930+0000","last_became_active":"2024-09-12T02:34:00.055344+0000","last_became_peered":"2024-09-12T02:34:00.055344+0000","last_unstale":"2024-09-12T02:34:07.895930+0000","last_undegraded":"2024-09-12T02:34:07.895930+0000","last_fullsized":"2024-09-12T02:34:07.895930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836209+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:08.836209+0000","last_peered":"2024-09-12T02:34:08.836209+0000","last_clean":"2024-09-12T02:34:08.836209+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:08.836209+0000","last_undegraded":"2024-09-12T02:34:08.836209+0000","last_fullsized":"2024-09-12T02:34:08.836209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095519+0000","last_change":"2024-09-12T02:34:05.658756+0000","last_active":"2024-09-12T02:34:07.095519+0000","last_peered":"2024-09-12T02:34:07.095519+0000","last_clean":"2024-09-12T02:34:07.095519+0000","last_became_active":"2024-09-12T02:34:05.658203+0000","last_became_peered":"2024-09-12T02:34:05.658203+0000","last_unstale":"2024-09-12T02:34:07.095519+0000","last_undegraded":"2024-09-12T02:34:07.095519+0000","last_fullsized":"2024-09-12T02:34:07.095519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836636+0000","last_change":"2024-09-12T02:34:01.069608+0000","last_active":"2024-09-12T02:34:08.836636+0000","last_peered":"2024-09-12T02:34:08.836636+0000","last_clean":"2024-09-12T02:34:08.836636+0000","last_became_active":"2024-09-12T02:34:01.069122+0000","last_became_peered":"2024-09-12T02:34:01.069122+0000","last_unstale":"2024-09-12T02:34:08.836636+0000","last_undegraded":"2024-09-12T02:34:08.836636+0000","last_fullsized":"2024-09-12T02:34:08.836636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090639+0000","last_change":"2024-09-12T02:34:00.054247+0000","last_active":"2024-09-12T02:34:07.090639+0000","last_peered":"2024-09-12T02:34:07.090639+0000","last_clean":"2024-09-12T02:34:07.090639+0000","last_became_active":"2024-09-12T02:34:00.053946+0000","last_became_peered":"2024-09-12T02:34:00.053946+0000","last_unstale":"2024-09-12T02:34:07.090639+0000","last_undegraded":"2024-09-12T02:34:07.090639+0000","last_fullsized":"2024-09-12T02:34:07.090639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:07.754916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:05.656456+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:05.656039+0000","last_became_peered":"2024-09-12T02:34:05.656039+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.059721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895983+0000","last_change":"2024-09-12T02:34:01.066544+0000","last_active":"2024-09-12T02:34:07.895983+0000","last_peered":"2024-09-12T02:34:07.895983+0000","last_clean":"2024-09-12T02:34:07.895983+0000","last_became_active":"2024-09-12T02:34:01.065801+0000","last_became_peered":"2024-09-12T02:34:01.065801+0000","last_unstale":"2024-09-12T02:34:07.895983+0000","last_undegraded":"2024-09-12T02:34:07.895983+0000","last_fullsized":"2024-09-12T02:34:07.895983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266060+0000","last_change":"2024-09-12T02:34:00.053363+0000","last_active":"2024-09-12T02:34:07.266060+0000","last_peered":"2024-09-12T02:34:07.266060+0000","last_clean":"2024-09-12T02:34:07.266060+0000","last_became_active":"2024-09-12T02:34:00.053091+0000","last_became_peered":"2024-09-12T02:34:00.053091+0000","last_unstale":"2024-09-12T02:34:07.266060+0000","last_undegraded":"2024-09-12T02:34:07.266060+0000","last_fullsized":"2024-09-12T02:34:07.266060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347382+0000","last_change":"2024-09-12T02:34:05.083388+0000","last_active":"2024-09-12T02:34:07.347382+0000","last_peered":"2024-09-12T02:34:07.347382+0000","last_clean":"2024-09-12T02:34:07.347382+0000","last_became_active":"2024-09-12T02:34:05.082457+0000","last_became_peered":"2024-09-12T02:34:05.082457+0000","last_unstale":"2024-09-12T02:34:07.347382+0000","last_undegraded":"2024-09-12T02:34:07.347382+0000","last_fullsized":"2024-09-12T02:34:07.347382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836912+0000","last_change":"2024-09-12T02:34:01.074931+0000","last_active":"2024-09-12T02:34:08.836912+0000","last_peered":"2024-09-12T02:34:08.836912+0000","last_clean":"2024-09-12T02:34:08.836912+0000","last_became_active":"2024-09-12T02:34:01.074653+0000","last_became_peered":"2024-09-12T02:34:01.074653+0000","last_unstale":"2024-09-12T02:34:08.836912+0000","last_undegraded":"2024-09-12T02:34:08.836912+0000","last_fullsized":"2024-09-12T02:34:08.836912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:43.458949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090480+0000","last_change":"2024-09-12T02:34:00.055519+0000","last_active":"2024-09-12T02:34:07.090480+0000","last_peered":"2024-09-12T02:34:07.090480+0000","last_clean":"2024-09-12T02:34:07.090480+0000","last_became_active":"2024-09-12T02:34:00.055196+0000","last_became_peered":"2024-09-12T02:34:00.055196+0000","last_unstale":"2024-09-12T02:34:07.090480+0000","last_undegraded":"2024-09-12T02:34:07.090480+0000","last_fullsized":"2024-09-12T02:34:07.090480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.742903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895518+0000","last_change":"2024-09-12T02:34:05.658643+0000","last_active":"2024-09-12T02:34:07.895518+0000","last_peered":"2024-09-12T02:34:07.895518+0000","last_clean":"2024-09-12T02:34:07.895518+0000","last_became_active":"2024-09-12T02:34:05.658201+0000","last_became_peered":"2024-09-12T02:34:05.658201+0000","last_unstale":"2024-09-12T02:34:07.895518+0000","last_undegraded":"2024-09-12T02:34:07.895518+0000","last_fullsized":"2024-09-12T02:34:07.895518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.544978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836870+0000","last_change":"2024-09-12T02:34:01.068158+0000","last_active":"2024-09-12T02:34:08.836870+0000","last_peered":"2024-09-12T02:34:08.836870+0000","last_clean":"2024-09-12T02:34:08.836870+0000","last_became_active":"2024-09-12T02:34:01.067814+0000","last_became_peered":"2024-09-12T02:34:01.067814+0000","last_unstale":"2024-09-12T02:34:08.836870+0000","last_undegraded":"2024-09-12T02:34:08.836870+0000","last_fullsized":"2024-09-12T02:34:08.836870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095425+0000","last_change":"2024-09-12T02:34:00.057323+0000","last_active":"2024-09-12T02:34:07.095425+0000","last_peered":"2024-09-12T02:34:07.095425+0000","last_clean":"2024-09-12T02:34:07.095425+0000","last_became_active":"2024-09-12T02:34:00.057029+0000","last_became_peered":"2024-09-12T02:34:00.057029+0000","last_unstale":"2024-09-12T02:34:07.095425+0000","last_undegraded":"2024-09-12T02:34:07.095425+0000","last_fullsized":"2024-09-12T02:34:07.095425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:59.639173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094272+0000","last_change":"2024-09-12T02:34:05.079794+0000","last_active":"2024-09-12T02:34:07.094272+0000","last_peered":"2024-09-12T02:34:07.094272+0000","last_clean":"2024-09-12T02:34:07.094272+0000","last_became_active":"2024-09-12T02:34:05.079405+0000","last_became_peered":"2024-09-12T02:34:05.079405+0000","last_unstale":"2024-09-12T02:34:07.094272+0000","last_undegraded":"2024-09-12T02:34:07.094272+0000","last_fullsized":"2024-09-12T02:34:07.094272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836441+0000","last_change":"2024-09-12T02:34:01.057423+0000","last_active":"2024-09-12T02:34:08.836441+0000","last_peered":"2024-09-12T02:34:08.836441+0000","last_clean":"2024-09-12T02:34:08.836441+0000","last_became_active":"2024-09-12T02:34:01.057128+0000","last_became_peered":"2024-09-12T02:34:01.057128+0000","last_unstale":"2024-09-12T02:34:08.836441+0000","last_undegraded":"2024-09-12T02:34:08.836441+0000","last_fullsized":"2024-09-12T02:34:08.836441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090168+0000","last_change":"2024-09-12T02:34:00.048532+0000","last_active":"2024-09-12T02:34:07.090168+0000","last_peered":"2024-09-12T02:34:07.090168+0000","last_clean":"2024-09-12T02:34:07.090168+0000","last_became_active":"2024-09-12T02:34:00.048245+0000","last_became_peered":"2024-09-12T02:34:00.048245+0000","last_unstale":"2024-09-12T02:34:07.090168+0000","last_undegraded":"2024-09-12T02:34:07.090168+0000","last_fullsized":"2024-09-12T02:34:07.090168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:23.482609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347436+0000","last_change":"2024-09-12T02:34:05.079264+0000","last_active":"2024-09-12T02:34:07.347436+0000","last_peered":"2024-09-12T02:34:07.347436+0000","last_clean":"2024-09-12T02:34:07.347436+0000","last_became_active":"2024-09-12T02:34:05.078754+0000","last_became_peered":"2024-09-12T02:34:05.078754+0000","last_unstale":"2024-09-12T02:34:07.347436+0000","last_undegraded":"2024-09-12T02:34:07.347436+0000","last_fullsized":"2024-09-12T02:34:07.347436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094120+0000","last_change":"2024-09-12T02:34:01.060623+0000","last_active":"2024-09-12T02:34:07.094120+0000","last_peered":"2024-09-12T02:34:07.094120+0000","last_clean":"2024-09-12T02:34:07.094120+0000","last_became_active":"2024-09-12T02:34:01.060339+0000","last_became_peered":"2024-09-12T02:34:01.060339+0000","last_unstale":"2024-09-12T02:34:07.094120+0000","last_undegraded":"2024-09-12T02:34:07.094120+0000","last_fullsized":"2024-09-12T02:34:07.094120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:00.051189+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:00.050920+0000","last_became_peered":"2024-09-12T02:34:00.050920+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562819+0000","last_change":"2024-09-12T02:34:05.658569+0000","last_active":"2024-09-12T02:34:08.562819+0000","last_peered":"2024-09-12T02:34:08.562819+0000","last_clean":"2024-09-12T02:34:08.562819+0000","last_became_active":"2024-09-12T02:34:05.658174+0000","last_became_peered":"2024-09-12T02:34:05.658174+0000","last_unstale":"2024-09-12T02:34:08.562819+0000","last_undegraded":"2024-09-12T02:34:08.562819+0000","last_fullsized":"2024-09-12T02:34:08.562819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:28.956735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836570+0000","last_change":"2024-09-12T02:34:01.065005+0000","last_active":"2024-09-12T02:34:08.836570+0000","last_peered":"2024-09-12T02:34:08.836570+0000","last_clean":"2024-09-12T02:34:08.836570+0000","last_became_active":"2024-09-12T02:34:01.064722+0000","last_became_peered":"2024-09-12T02:34:01.064722+0000","last_unstale":"2024-09-12T02:34:08.836570+0000","last_undegraded":"2024-09-12T02:34:08.836570+0000","last_fullsized":"2024-09-12T02:34:08.836570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895958+0000","last_change":"2024-09-12T02:34:00.058485+0000","last_active":"2024-09-12T02:34:07.895958+0000","last_peered":"2024-09-12T02:34:07.895958+0000","last_clean":"2024-09-12T02:34:07.895958+0000","last_became_active":"2024-09-12T02:34:00.058013+0000","last_became_peered":"2024-09-12T02:34:00.058013+0000","last_unstale":"2024-09-12T02:34:07.895958+0000","last_undegraded":"2024-09-12T02:34:07.895958+0000","last_fullsized":"2024-09-12T02:34:07.895958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562509+0000","last_change":"2024-09-12T02:34:05.659437+0000","last_active":"2024-09-12T02:34:08.562509+0000","last_peered":"2024-09-12T02:34:08.562509+0000","last_clean":"2024-09-12T02:34:08.562509+0000","last_became_active":"2024-09-12T02:34:05.658091+0000","last_became_peered":"2024-09-12T02:34:05.658091+0000","last_unstale":"2024-09-12T02:34:08.562509+0000","last_undegraded":"2024-09-12T02:34:08.562509+0000","last_fullsized":"2024-09-12T02:34:08.562509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:49.468958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347237+0000","last_change":"2024-09-12T02:34:01.058834+0000","last_active":"2024-09-12T02:34:07.347237+0000","last_peered":"2024-09-12T02:34:07.347237+0000","last_clean":"2024-09-12T02:34:07.347237+0000","last_became_active":"2024-09-12T02:34:01.058557+0000","last_became_peered":"2024-09-12T02:34:01.058557+0000","last_unstale":"2024-09-12T02:34:07.347237+0000","last_undegraded":"2024-09-12T02:34:07.347237+0000","last_fullsized":"2024-09-12T02:34:07.347237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347544+0000","last_change":"2024-09-12T02:34:00.057001+0000","last_active":"2024-09-12T02:34:07.347544+0000","last_peered":"2024-09-12T02:34:07.347544+0000","last_clean":"2024-09-12T02:34:07.347544+0000","last_became_active":"2024-09-12T02:34:00.056685+0000","last_became_peered":"2024-09-12T02:34:00.056685+0000","last_unstale":"2024-09-12T02:34:07.347544+0000","last_undegraded":"2024-09-12T02:34:07.347544+0000","last_fullsized":"2024-09-12T02:34:07.347544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.793722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896082+0000","last_change":"2024-09-12T02:34:05.660619+0000","last_active":"2024-09-12T02:34:07.896082+0000","last_peered":"2024-09-12T02:34:07.896082+0000","last_clean":"2024-09-12T02:34:07.896082+0000","last_became_active":"2024-09-12T02:34:05.659790+0000","last_became_peered":"2024-09-12T02:34:05.659790+0000","last_unstale":"2024-09-12T02:34:07.896082+0000","last_undegraded":"2024-09-12T02:34:07.896082+0000","last_fullsized":"2024-09-12T02:34:07.896082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:38.472945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836579+0000","last_change":"2024-09-12T02:34:01.069392+0000","last_active":"2024-09-12T02:34:08.836579+0000","last_peered":"2024-09-12T02:34:08.836579+0000","last_clean":"2024-09-12T02:34:08.836579+0000","last_became_active":"2024-09-12T02:34:01.069065+0000","last_became_peered":"2024-09-12T02:34:01.069065+0000","last_unstale":"2024-09-12T02:34:08.836579+0000","last_undegraded":"2024-09-12T02:34:08.836579+0000","last_fullsized":"2024-09-12T02:34:08.836579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:10.464560+0000","last_change":"2024-09-12T02:34:00.058230+0000","last_active":"2024-09-12T02:34:10.464560+0000","last_peered":"2024-09-12T02:34:10.464560+0000","last_clean":"2024-09-12T02:34:10.464560+0000","last_became_active":"2024-09-12T02:34:00.057965+0000","last_became_peered":"2024-09-12T02:34:00.057965+0000","last_unstale":"2024-09-12T02:34:10.464560+0000","last_undegraded":"2024-09-12T02:34:10.464560+0000","last_fullsized":"2024-09-12T02:34:10.464560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265696+0000","last_change":"2024-09-12T02:34:05.084205+0000","last_active":"2024-09-12T02:34:07.265696+0000","last_peered":"2024-09-12T02:34:07.265696+0000","last_clean":"2024-09-12T02:34:07.265696+0000","last_became_active":"2024-09-12T02:34:05.083830+0000","last_became_peered":"2024-09-12T02:34:05.083830+0000","last_unstale":"2024-09-12T02:34:07.265696+0000","last_undegraded":"2024-09-12T02:34:07.265696+0000","last_fullsized":"2024-09-12T02:34:07.265696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095341+0000","last_change":"2024-09-12T02:34:01.059209+0000","last_active":"2024-09-12T02:34:07.095341+0000","last_peered":"2024-09-12T02:34:07.095341+0000","last_clean":"2024-09-12T02:34:07.095341+0000","last_became_active":"2024-09-12T02:34:01.058918+0000","last_became_peered":"2024-09-12T02:34:01.058918+0000","last_unstale":"2024-09-12T02:34:07.095341+0000","last_undegraded":"2024-09-12T02:34:07.095341+0000","last_fullsized":"2024-09-12T02:34:07.095341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.313534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266057+0000","last_change":"2024-09-12T02:34:00.054000+0000","last_active":"2024-09-12T02:34:07.266057+0000","last_peered":"2024-09-12T02:34:07.266057+0000","last_clean":"2024-09-12T02:34:07.266057+0000","last_became_active":"2024-09-12T02:34:00.053740+0000","last_became_peered":"2024-09-12T02:34:00.053740+0000","last_unstale":"2024-09-12T02:34:07.266057+0000","last_undegraded":"2024-09-12T02:34:07.266057+0000","last_fullsized":"2024-09-12T02:34:07.266057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094290+0000","last_change":"2024-09-12T02:34:05.076783+0000","last_active":"2024-09-12T02:34:07.094290+0000","last_peered":"2024-09-12T02:34:07.094290+0000","last_clean":"2024-09-12T02:34:07.094290+0000","last_became_active":"2024-09-12T02:34:05.076363+0000","last_became_peered":"2024-09-12T02:34:05.076363+0000","last_unstale":"2024-09-12T02:34:07.094290+0000","last_undegraded":"2024-09-12T02:34:07.094290+0000","last_fullsized":"2024-09-12T02:34:07.094290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:25.870250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347370+0000","last_change":"2024-09-12T02:34:01.066781+0000","last_active":"2024-09-12T02:34:07.347370+0000","last_peered":"2024-09-12T02:34:07.347370+0000","last_clean":"2024-09-12T02:34:07.347370+0000","last_became_active":"2024-09-12T02:34:01.066488+0000","last_became_peered":"2024-09-12T02:34:01.066488+0000","last_unstale":"2024-09-12T02:34:07.347370+0000","last_undegraded":"2024-09-12T02:34:07.347370+0000","last_fullsized":"2024-09-12T02:34:07.347370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896103+0000","last_change":"2024-09-12T02:34:00.053362+0000","last_active":"2024-09-12T02:34:07.896103+0000","last_peered":"2024-09-12T02:34:07.896103+0000","last_clean":"2024-09-12T02:34:07.896103+0000","last_became_active":"2024-09-12T02:34:00.053065+0000","last_became_peered":"2024-09-12T02:34:00.053065+0000","last_unstale":"2024-09-12T02:34:07.896103+0000","last_undegraded":"2024-09-12T02:34:07.896103+0000","last_fullsized":"2024-09-12T02:34:07.896103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562161+0000","last_change":"2024-09-12T02:34:05.078084+0000","last_active":"2024-09-12T02:34:08.562161+0000","last_peered":"2024-09-12T02:34:08.562161+0000","last_clean":"2024-09-12T02:34:08.562161+0000","last_became_active":"2024-09-12T02:34:05.077651+0000","last_became_peered":"2024-09-12T02:34:05.077651+0000","last_unstale":"2024-09-12T02:34:08.562161+0000","last_undegraded":"2024-09-12T02:34:08.562161+0000","last_fullsized":"2024-09-12T02:34:08.562161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:12.453888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896027+0000","last_change":"2024-09-12T02:34:01.069626+0000","last_active":"2024-09-12T02:34:07.896027+0000","last_peered":"2024-09-12T02:34:07.896027+0000","last_clean":"2024-09-12T02:34:07.896027+0000","last_became_active":"2024-09-12T02:34:01.069377+0000","last_became_peered":"2024-09-12T02:34:01.069377+0000","last_unstale":"2024-09-12T02:34:07.896027+0000","last_undegraded":"2024-09-12T02:34:07.896027+0000","last_fullsized":"2024-09-12T02:34:07.896027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:00.054287+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:00.054015+0000","last_became_peered":"2024-09-12T02:34:00.054015+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562172+0000","last_change":"2024-09-12T02:34:05.662260+0000","last_active":"2024-09-12T02:34:08.562172+0000","last_peered":"2024-09-12T02:34:08.562172+0000","last_clean":"2024-09-12T02:34:08.562172+0000","last_became_active":"2024-09-12T02:34:05.662024+0000","last_became_peered":"2024-09-12T02:34:05.662024+0000","last_unstale":"2024-09-12T02:34:08.562172+0000","last_undegraded":"2024-09-12T02:34:08.562172+0000","last_fullsized":"2024-09-12T02:34:08.562172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:58.165661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347329+0000","last_change":"2024-09-12T02:34:05.659237+0000","last_active":"2024-09-12T02:34:07.347329+0000","last_peered":"2024-09-12T02:34:07.347329+0000","last_clean":"2024-09-12T02:34:07.347329+0000","last_became_active":"2024-09-12T02:34:05.658549+0000","last_became_peered":"2024-09-12T02:34:05.658549+0000","last_unstale":"2024-09-12T02:34:07.347329+0000","last_undegraded":"2024-09-12T02:34:07.347329+0000","last_fullsized":"2024-09-12T02:34:07.347329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265465+0000","last_change":"2024-09-12T02:34:01.053018+0000","last_active":"2024-09-12T02:34:07.265465+0000","last_peered":"2024-09-12T02:34:07.265465+0000","last_clean":"2024-09-12T02:34:07.265465+0000","last_became_active":"2024-09-12T02:34:01.052640+0000","last_became_peered":"2024-09-12T02:34:01.052640+0000","last_unstale":"2024-09-12T02:34:07.265465+0000","last_undegraded":"2024-09-12T02:34:07.265465+0000","last_fullsized":"2024-09-12T02:34:07.265465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895717+0000","last_change":"2024-09-12T02:34:00.059071+0000","last_active":"2024-09-12T02:34:07.895717+0000","last_peered":"2024-09-12T02:34:07.895717+0000","last_clean":"2024-09-12T02:34:07.895717+0000","last_became_active":"2024-09-12T02:34:00.058712+0000","last_became_peered":"2024-09-12T02:34:00.058712+0000","last_unstale":"2024-09-12T02:34:07.895717+0000","last_undegraded":"2024-09-12T02:34:07.895717+0000","last_fullsized":"2024-09-12T02:34:07.895717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:05.078933+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:05.078471+0000","last_became_peered":"2024-09-12T02:34:05.078471+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562145+0000","last_change":"2024-09-12T02:34:01.062159+0000","last_active":"2024-09-12T02:34:08.562145+0000","last_peered":"2024-09-12T02:34:08.562145+0000","last_clean":"2024-09-12T02:34:08.562145+0000","last_became_active":"2024-09-12T02:34:01.061853+0000","last_became_peered":"2024-09-12T02:34:01.061853+0000","last_unstale":"2024-09-12T02:34:08.562145+0000","last_undegraded":"2024-09-12T02:34:08.562145+0000","last_fullsized":"2024-09-12T02:34:08.562145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:30.820938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561699+0000","last_change":"2024-09-12T02:34:00.059938+0000","last_active":"2024-09-12T02:34:08.561699+0000","last_peered":"2024-09-12T02:34:08.561699+0000","last_clean":"2024-09-12T02:34:08.561699+0000","last_became_active":"2024-09-12T02:34:00.059625+0000","last_became_peered":"2024-09-12T02:34:00.059625+0000","last_unstale":"2024-09-12T02:34:08.561699+0000","last_undegraded":"2024-09-12T02:34:08.561699+0000","last_fullsized":"2024-09-12T02:34:08.561699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:40.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094779+0000","last_change":"2024-09-12T02:34:00.048853+0000","last_active":"2024-09-12T02:34:07.094779+0000","last_peered":"2024-09-12T02:34:07.094779+0000","last_clean":"2024-09-12T02:34:07.094779+0000","last_became_active":"2024-09-12T02:34:00.048563+0000","last_became_peered":"2024-09-12T02:34:00.048563+0000","last_unstale":"2024-09-12T02:34:07.094779+0000","last_undegraded":"2024-09-12T02:34:07.094779+0000","last_fullsized":"2024-09-12T02:34:07.094779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.056880+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.056573+0000","last_became_peered":"2024-09-12T02:34:01.056573+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090610+0000","last_change":"2024-09-12T02:34:05.079707+0000","last_active":"2024-09-12T02:34:07.090610+0000","last_peered":"2024-09-12T02:34:07.090610+0000","last_clean":"2024-09-12T02:34:07.090610+0000","last_became_active":"2024-09-12T02:34:05.079349+0000","last_became_peered":"2024-09-12T02:34:05.079349+0000","last_unstale":"2024-09-12T02:34:07.090610+0000","last_undegraded":"2024-09-12T02:34:07.090610+0000","last_fullsized":"2024-09-12T02:34:07.090610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:17.011167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562431+0000","last_change":"2024-09-12T02:34:00.057281+0000","last_active":"2024-09-12T02:34:08.562431+0000","last_peered":"2024-09-12T02:34:08.562431+0000","last_clean":"2024-09-12T02:34:08.562431+0000","last_became_active":"2024-09-12T02:34:00.057004+0000","last_became_peered":"2024-09-12T02:34:00.057004+0000","last_unstale":"2024-09-12T02:34:08.562431+0000","last_undegraded":"2024-09-12T02:34:08.562431+0000","last_fullsized":"2024-09-12T02:34:08.562431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:23.045646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094064+0000","last_change":"2024-09-12T02:34:01.056167+0000","last_active":"2024-09-12T02:34:07.094064+0000","last_peered":"2024-09-12T02:34:07.094064+0000","last_clean":"2024-09-12T02:34:07.094064+0000","last_became_active":"2024-09-12T02:34:01.055914+0000","last_became_peered":"2024-09-12T02:34:01.055914+0000","last_unstale":"2024-09-12T02:34:07.094064+0000","last_undegraded":"2024-09-12T02:34:07.094064+0000","last_fullsized":"2024-09-12T02:34:07.094064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:06.967072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562579+0000","last_change":"2024-09-12T02:34:05.078328+0000","last_active":"2024-09-12T02:34:08.562579+0000","last_peered":"2024-09-12T02:34:08.562579+0000","last_clean":"2024-09-12T02:34:08.562579+0000","last_became_active":"2024-09-12T02:34:05.077613+0000","last_became_peered":"2024-09-12T02:34:05.077613+0000","last_unstale":"2024-09-12T02:34:08.562579+0000","last_undegraded":"2024-09-12T02:34:08.562579+0000","last_fullsized":"2024-09-12T02:34:08.562579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.567364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093915+0000","last_change":"2024-09-12T02:34:01.061088+0000","last_active":"2024-09-12T02:34:07.093915+0000","last_peered":"2024-09-12T02:34:07.093915+0000","last_clean":"2024-09-12T02:34:07.093915+0000","last_became_active":"2024-09-12T02:34:01.060388+0000","last_became_peered":"2024-09-12T02:34:01.060388+0000","last_unstale":"2024-09-12T02:34:07.093915+0000","last_undegraded":"2024-09-12T02:34:07.093915+0000","last_fullsized":"2024-09-12T02:34:07.093915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090261+0000","last_change":"2024-09-12T02:34:01.057775+0000","last_active":"2024-09-12T02:34:07.090261+0000","last_peered":"2024-09-12T02:34:07.090261+0000","last_clean":"2024-09-12T02:34:07.090261+0000","last_became_active":"2024-09-12T02:34:01.057444+0000","last_became_peered":"2024-09-12T02:34:01.057444+0000","last_unstale":"2024-09-12T02:34:07.090261+0000","last_undegraded":"2024-09-12T02:34:07.090261+0000","last_fullsized":"2024-09-12T02:34:07.090261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:59.156424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895959+0000","last_change":"2024-09-12T02:34:01.064983+0000","last_active":"2024-09-12T02:34:07.895959+0000","last_peered":"2024-09-12T02:34:07.895959+0000","last_clean":"2024-09-12T02:34:07.895959+0000","last_became_active":"2024-09-12T02:34:01.064526+0000","last_became_peered":"2024-09-12T02:34:01.064526+0000","last_unstale":"2024-09-12T02:34:07.895959+0000","last_undegraded":"2024-09-12T02:34:07.895959+0000","last_fullsized":"2024-09-12T02:34:07.895959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.055170+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.054896+0000","last_became_peered":"2024-09-12T02:34:01.054896+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562609+0000","last_change":"2024-09-12T02:34:01.058376+0000","last_active":"2024-09-12T02:34:08.562609+0000","last_peered":"2024-09-12T02:34:08.562609+0000","last_clean":"2024-09-12T02:34:08.562609+0000","last_became_active":"2024-09-12T02:34:01.058094+0000","last_became_peered":"2024-09-12T02:34:01.058094+0000","last_unstale":"2024-09-12T02:34:08.562609+0000","last_undegraded":"2024-09-12T02:34:08.562609+0000","last_fullsized":"2024-09-12T02:34:08.562609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:23.542579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.049857+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049533+0000","last_became_peered":"2024-09-12T02:34:01.049533+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095094+0000","last_change":"2024-09-12T02:34:01.059501+0000","last_active":"2024-09-12T02:34:07.095094+0000","last_peered":"2024-09-12T02:34:07.095094+0000","last_clean":"2024-09-12T02:34:07.095094+0000","last_became_active":"2024-09-12T02:34:01.059225+0000","last_became_peered":"2024-09-12T02:34:01.059225+0000","last_unstale":"2024-09-12T02:34:07.095094+0000","last_undegraded":"2024-09-12T02:34:07.095094+0000","last_fullsized":"2024-09-12T02:34:07.095094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562804+0000","last_change":"2024-09-12T02:34:01.055984+0000","last_active":"2024-09-12T02:34:08.562804+0000","last_peered":"2024-09-12T02:34:08.562804+0000","last_clean":"2024-09-12T02:34:08.562804+0000","last_became_active":"2024-09-12T02:34:01.055717+0000","last_became_peered":"2024-09-12T02:34:01.055717+0000","last_unstale":"2024-09-12T02:34:08.562804+0000","last_undegraded":"2024-09-12T02:34:08.562804+0000","last_fullsized":"2024-09-12T02:34:08.562804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895650+0000","last_change":"2024-09-12T02:34:01.065533+0000","last_active":"2024-09-12T02:34:07.895650+0000","last_peered":"2024-09-12T02:34:07.895650+0000","last_clean":"2024-09-12T02:34:07.895650+0000","last_became_active":"2024-09-12T02:34:01.065247+0000","last_became_peered":"2024-09-12T02:34:01.065247+0000","last_unstale":"2024-09-12T02:34:07.895650+0000","last_undegraded":"2024-09-12T02:34:07.895650+0000","last_fullsized":"2024-09-12T02:34:07.895650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:40.545417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562279+0000","last_change":"2024-09-12T02:34:01.056565+0000","last_active":"2024-09-12T02:34:08.562279+0000","last_peered":"2024-09-12T02:34:08.562279+0000","last_clean":"2024-09-12T02:34:08.562279+0000","last_became_active":"2024-09-12T02:34:01.056227+0000","last_became_peered":"2024-09-12T02:34:01.056227+0000","last_unstale":"2024-09-12T02:34:08.562279+0000","last_undegraded":"2024-09-12T02:34:08.562279+0000","last_fullsized":"2024-09-12T02:34:08.562279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:47.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895752+0000","last_change":"2024-09-12T02:34:01.070313+0000","last_active":"2024-09-12T02:34:07.895752+0000","last_peered":"2024-09-12T02:34:07.895752+0000","last_clean":"2024-09-12T02:34:07.895752+0000","last_became_active":"2024-09-12T02:34:01.070031+0000","last_became_peered":"2024-09-12T02:34:01.070031+0000","last_unstale":"2024-09-12T02:34:07.895752+0000","last_undegraded":"2024-09-12T02:34:07.895752+0000","last_fullsized":"2024-09-12T02:34:07.895752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:59.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347244+0000","last_change":"2024-09-12T02:34:01.060012+0000","last_active":"2024-09-12T02:34:07.347244+0000","last_peered":"2024-09-12T02:34:07.347244+0000","last_clean":"2024-09-12T02:34:07.347244+0000","last_became_active":"2024-09-12T02:34:01.059756+0000","last_became_peered":"2024-09-12T02:34:01.059756+0000","last_unstale":"2024-09-12T02:34:07.347244+0000","last_undegraded":"2024-09-12T02:34:07.347244+0000","last_fullsized":"2024-09-12T02:34:07.347244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.654168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094908+0000","last_change":"2024-09-12T02:34:01.056798+0000","last_active":"2024-09-12T02:34:07.094908+0000","last_peered":"2024-09-12T02:34:07.094908+0000","last_clean":"2024-09-12T02:34:07.094908+0000","last_became_active":"2024-09-12T02:34:01.056523+0000","last_became_peered":"2024-09-12T02:34:01.056523+0000","last_unstale":"2024-09-12T02:34:07.094908+0000","last_undegraded":"2024-09-12T02:34:07.094908+0000","last_fullsized":"2024-09-12T02:34:07.094908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836766+0000","last_change":"2024-09-12T02:34:01.069679+0000","last_active":"2024-09-12T02:34:08.836766+0000","last_peered":"2024-09-12T02:34:08.836766+0000","last_clean":"2024-09-12T02:34:08.836766+0000","last_became_active":"2024-09-12T02:34:01.069397+0000","last_became_peered":"2024-09-12T02:34:01.069397+0000","last_unstale":"2024-09-12T02:34:08.836766+0000","last_undegraded":"2024-09-12T02:34:08.836766+0000","last_fullsized":"2024-09-12T02:34:08.836766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:08.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090422+0000","last_change":"2024-09-12T02:34:01.054994+0000","last_active":"2024-09-12T02:34:07.090422+0000","last_peered":"2024-09-12T02:34:07.090422+0000","last_clean":"2024-09-12T02:34:07.090422+0000","last_became_active":"2024-09-12T02:34:01.054724+0000","last_became_peered":"2024-09-12T02:34:01.054724+0000","last_unstale":"2024-09-12T02:34:07.090422+0000","last_undegraded":"2024-09-12T02:34:07.090422+0000","last_fullsized":"2024-09-12T02:34:07.090422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:34.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896338+0000","last_change":"2024-09-12T02:34:01.076336+0000","last_active":"2024-09-12T02:34:07.896338+0000","last_peered":"2024-09-12T02:34:07.896338+0000","last_clean":"2024-09-12T02:34:07.896338+0000","last_became_active":"2024-09-12T02:34:01.075961+0000","last_became_peered":"2024-09-12T02:34:01.075961+0000","last_unstale":"2024-09-12T02:34:07.896338+0000","last_undegraded":"2024-09-12T02:34:07.896338+0000","last_fullsized":"2024-09-12T02:34:07.896338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895531+0000","last_change":"2024-09-12T02:34:01.067021+0000","last_active":"2024-09-12T02:34:07.895531+0000","last_peered":"2024-09-12T02:34:07.895531+0000","last_clean":"2024-09-12T02:34:07.895531+0000","last_became_active":"2024-09-12T02:34:01.065834+0000","last_became_peered":"2024-09-12T02:34:01.065834+0000","last_unstale":"2024-09-12T02:34:07.895531+0000","last_undegraded":"2024-09-12T02:34:07.895531+0000","last_fullsized":"2024-09-12T02:34:07.895531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265540+0000","last_change":"2024-09-12T02:34:01.052768+0000","last_active":"2024-09-12T02:34:07.265540+0000","last_peered":"2024-09-12T02:34:07.265540+0000","last_clean":"2024-09-12T02:34:07.265540+0000","last_became_active":"2024-09-12T02:34:01.052482+0000","last_became_peered":"2024-09-12T02:34:01.052482+0000","last_unstale":"2024-09-12T02:34:07.265540+0000","last_undegraded":"2024-09-12T02:34:07.265540+0000","last_fullsized":"2024-09-12T02:34:07.265540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347203+0000","last_change":"2024-09-12T02:34:01.055910+0000","last_active":"2024-09-12T02:34:07.347203+0000","last_peered":"2024-09-12T02:34:07.347203+0000","last_clean":"2024-09-12T02:34:07.347203+0000","last_became_active":"2024-09-12T02:34:01.055652+0000","last_became_peered":"2024-09-12T02:34:01.055652+0000","last_unstale":"2024-09-12T02:34:07.347203+0000","last_undegraded":"2024-09-12T02:34:07.347203+0000","last_fullsized":"2024-09-12T02:34:07.347203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:30.649532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562369+0000","last_change":"2024-09-12T02:34:01.061023+0000","last_active":"2024-09-12T02:34:08.562369+0000","last_peered":"2024-09-12T02:34:08.562369+0000","last_clean":"2024-09-12T02:34:08.562369+0000","last_became_active":"2024-09-12T02:34:01.060672+0000","last_became_peered":"2024-09-12T02:34:01.060672+0000","last_unstale":"2024-09-12T02:34:08.562369+0000","last_undegraded":"2024-09-12T02:34:08.562369+0000","last_fullsized":"2024-09-12T02:34:08.562369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.491024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095250+0000","last_change":"2024-09-12T02:34:01.061215+0000","last_active":"2024-09-12T02:34:07.095250+0000","last_peered":"2024-09-12T02:34:07.095250+0000","last_clean":"2024-09-12T02:34:07.095250+0000","last_became_active":"2024-09-12T02:34:01.060951+0000","last_became_peered":"2024-09-12T02:34:01.060951+0000","last_unstale":"2024-09-12T02:34:07.095250+0000","last_undegraded":"2024-09-12T02:34:07.095250+0000","last_fullsized":"2024-09-12T02:34:07.095250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:13.069032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095546+0000","last_change":"2024-09-12T02:34:01.070066+0000","last_active":"2024-09-12T02:34:07.095546+0000","last_peered":"2024-09-12T02:34:07.095546+0000","last_clean":"2024-09-12T02:34:07.095546+0000","last_became_active":"2024-09-12T02:34:01.069783+0000","last_became_peered":"2024-09-12T02:34:01.069783+0000","last_unstale":"2024-09-12T02:34:07.095546+0000","last_undegraded":"2024-09-12T02:34:07.095546+0000","last_fullsized":"2024-09-12T02:34:07.095546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094984+0000","last_change":"2024-09-12T02:34:01.070083+0000","last_active":"2024-09-12T02:34:07.094984+0000","last_peered":"2024-09-12T02:34:07.094984+0000","last_clean":"2024-09-12T02:34:07.094984+0000","last_became_active":"2024-09-12T02:34:01.069808+0000","last_became_peered":"2024-09-12T02:34:01.069808+0000","last_unstale":"2024-09-12T02:34:07.094984+0000","last_undegraded":"2024-09-12T02:34:07.094984+0000","last_fullsized":"2024-09-12T02:34:07.094984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836872+0000","last_change":"2024-09-12T02:34:01.074865+0000","last_active":"2024-09-12T02:34:08.836872+0000","last_peered":"2024-09-12T02:34:08.836872+0000","last_clean":"2024-09-12T02:34:08.836872+0000","last_became_active":"2024-09-12T02:34:01.074473+0000","last_became_peered":"2024-09-12T02:34:01.074473+0000","last_unstale":"2024-09-12T02:34:08.836872+0000","last_undegraded":"2024-09-12T02:34:08.836872+0000","last_fullsized":"2024-09-12T02:34:08.836872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:21.843182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562043+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:08.562043+0000","last_peered":"2024-09-12T02:34:08.562043+0000","last_clean":"2024-09-12T02:34:08.562043+0000","last_became_active":"2024-09-12T02:34:01.067024+0000","last_became_peered":"2024-09-12T02:34:01.067024+0000","last_unstale":"2024-09-12T02:34:08.562043+0000","last_undegraded":"2024-09-12T02:34:08.562043+0000","last_fullsized":"2024-09-12T02:34:08.562043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:56.143361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836303+0000","last_change":"2024-09-12T02:34:01.058244+0000","last_active":"2024-09-12T02:34:08.836303+0000","last_peered":"2024-09-12T02:34:08.836303+0000","last_clean":"2024-09-12T02:34:08.836303+0000","last_became_active":"2024-09-12T02:34:01.057968+0000","last_became_peered":"2024-09-12T02:34:01.057968+0000","last_unstale":"2024-09-12T02:34:08.836303+0000","last_undegraded":"2024-09-12T02:34:08.836303+0000","last_fullsized":"2024-09-12T02:34:08.836303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895748+0000","last_change":"2024-09-12T02:34:01.067464+0000","last_active":"2024-09-12T02:34:07.895748+0000","last_peered":"2024-09-12T02:34:07.895748+0000","last_clean":"2024-09-12T02:34:07.895748+0000","last_became_active":"2024-09-12T02:34:01.065862+0000","last_became_peered":"2024-09-12T02:34:01.065862+0000","last_unstale":"2024-09-12T02:34:07.895748+0000","last_undegraded":"2024-09-12T02:34:07.895748+0000","last_fullsized":"2024-09-12T02:34:07.895748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836442+0000","last_change":"2024-09-12T02:34:01.068831+0000","last_active":"2024-09-12T02:34:08.836442+0000","last_peered":"2024-09-12T02:34:08.836442+0000","last_clean":"2024-09-12T02:34:08.836442+0000","last_became_active":"2024-09-12T02:34:01.066724+0000","last_became_peered":"2024-09-12T02:34:01.066724+0000","last_unstale":"2024-09-12T02:34:08.836442+0000","last_undegraded":"2024-09-12T02:34:08.836442+0000","last_fullsized":"2024-09-12T02:34:08.836442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895852+0000","last_change":"2024-09-12T02:34:01.065590+0000","last_active":"2024-09-12T02:34:07.895852+0000","last_peered":"2024-09-12T02:34:07.895852+0000","last_clean":"2024-09-12T02:34:07.895852+0000","last_became_active":"2024-09-12T02:34:01.065308+0000","last_became_peered":"2024-09-12T02:34:01.065308+0000","last_unstale":"2024-09-12T02:34:07.895852+0000","last_undegraded":"2024-09-12T02:34:07.895852+0000","last_fullsized":"2024-09-12T02:34:07.895852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347223+0000","last_change":"2024-09-12T02:34:01.056168+0000","last_active":"2024-09-12T02:34:07.347223+0000","last_peered":"2024-09-12T02:34:07.347223+0000","last_clean":"2024-09-12T02:34:07.347223+0000","last_became_active":"2024-09-12T02:34:01.055731+0000","last_became_peered":"2024-09-12T02:34:01.055731+0000","last_unstale":"2024-09-12T02:34:07.347223+0000","last_undegraded":"2024-09-12T02:34:07.347223+0000","last_fullsized":"2024-09-12T02:34:07.347223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266139+0000","last_change":"2024-09-12T02:34:01.060961+0000","last_active":"2024-09-12T02:34:07.266139+0000","last_peered":"2024-09-12T02:34:07.266139+0000","last_clean":"2024-09-12T02:34:07.266139+0000","last_became_active":"2024-09-12T02:34:01.060669+0000","last_became_peered":"2024-09-12T02:34:01.060669+0000","last_unstale":"2024-09-12T02:34:07.266139+0000","last_undegraded":"2024-09-12T02:34:07.266139+0000","last_fullsized":"2024-09-12T02:34:07.266139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836765+0000","last_change":"2024-09-12T02:34:01.074156+0000","last_active":"2024-09-12T02:34:08.836765+0000","last_peered":"2024-09-12T02:34:08.836765+0000","last_clean":"2024-09-12T02:34:08.836765+0000","last_became_active":"2024-09-12T02:34:01.073860+0000","last_became_peered":"2024-09-12T02:34:01.073860+0000","last_unstale":"2024-09-12T02:34:08.836765+0000","last_undegraded":"2024-09-12T02:34:08.836765+0000","last_fullsized":"2024-09-12T02:34:08.836765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476747,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":704005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476746,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476746,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":113181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":113215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":704061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":113055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:21.520 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:34:21.520 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:34:21.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:34:21.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T02:34:21.521 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T02:34:21.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.653+0000 7f6bd0f5f640 1 Processor -- start 2024-09-12T02:34:21.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.653+0000 7f6bd0f5f640 1 -- start start 2024-09-12T02:34:21.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bd0f5f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bd0f5f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bd0f5f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc0b6520 con 0x7f6bcc0ae140 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bd0f5f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6bcc0b17f0 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bd0f5f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6bcc0b1a40 con 0x7f6bcc15e990 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bca59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bca59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56700/0 (socket says 172.21.15.119:56700) 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.654+0000 7f6bca59c640 1 -- 172.21.15.119:0/372079219 learned_addr learned my addr 172.21.15.119:0/372079219 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.655+0000 7f6bc3fff640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.655+0000 7f6bca59c640 1 -- 172.21.15.119:0/372079219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 msgr2=0x7f6bcc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:21.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.655+0000 7f6bca59c640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.655+0000 7f6bca59c640 1 -- 172.21.15.119:0/372079219 >> v1:172.21.15.153:6789/0 conn(0x7f6bcc0ae140 legacy=0x7f6bcc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.655+0000 7f6bca59c640 1 -- 172.21.15.119:0/372079219 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc0b1d20 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bca59c640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009870 tx=0x7f6bbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8a84735fd4c943 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bc9d9b640 1 -- 172.21.15.119:0/372079219 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc037070 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bc9d9b640 1 -- 172.21.15.119:0/372079219 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bbc032440 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bc9d9b640 1 -- 172.21.15.119:0/372079219 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc032810 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/372079219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 msgr2=0x7f6bcc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009870 tx=0x7f6bbc02a270 comp rx=0 tx=0).stop 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/372079219 shutdown_connections 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/372079219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc0b5f40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/372079219 >> 172.21.15.119:0/372079219 conn(0x7f6bcc073490 msgr2=0x7f6bcc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/372079219 shutdown_connections 2024-09-12T02:34:21.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.656+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/372079219 wait complete. 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.658+0000 7f6bd0f5f640 1 Processor -- start 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.658+0000 7f6bd0f5f640 1 -- start start 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bcc0ae140 0x7f6bcc0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0b2a60 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0b0490 con 0x7f6bcc0ae140 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bd0f5f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6bcc0b2be0 con 0x7f6bcc15e990 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56712/0 (socket says 172.21.15.119:56712) 2024-09-12T02:34:21.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 -- 172.21.15.119:0/1237158501 learned_addr learned my addr 172.21.15.119:0/1237158501 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bca59c640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bcc0ae140 0x7f6bcc0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bcad9d640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 -- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 msgr2=0x7f6bcc0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 -- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bcc0ae140 msgr2=0x7f6bcc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bcc0ae140 0x7f6bcc0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.659+0000 7f6bc3fff640 1 -- 172.21.15.119:0/1237158501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc0cee50 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bc3fff640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e870 tx=0x7f6bb400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4017070 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb400c940 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400cd10 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc15efa0 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.660+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bcc155280 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.661+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bcc0b5f40 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.661+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bb401a070 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.662+0000 7f6bc2ffd640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.662+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6bb408b330 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.662+0000 7f6bca59c640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.662+0000 7f6bca59c640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 0x7f6bac06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc034000 tx=0x7f6bbc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.666+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bb4059350 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.876+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6bcc0701c0 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.879+0000 7f6bc2ffd640 1 -- 172.21.15.119:0/1237158501 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172944 (secure 0 0 0) 0x7f6bb405d650 con 0x7f6bcc15e5b0 2024-09-12T02:34:21.881 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 msgr2=0x7f6bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 0x7f6bac06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc034000 tx=0x7f6bbc02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 msgr2=0x7f6bcc154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e870 tx=0x7f6bb400ed30 comp rx=0 tx=0).stop 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 shutdown_connections 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bcc15e990 0x7f6bcc0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc15e5b0 0x7f6bcc154d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 --2- 172.21.15.119:0/1237158501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bcc0ae140 0x7f6bcc0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 >> 172.21.15.119:0/1237158501 conn(0x7f6bcc073490 msgr2=0x7f6bcc0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 shutdown_connections 2024-09-12T02:34:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.881+0000 7f6bd0f5f640 1 -- 172.21.15.119:0/1237158501 wait complete. 2024-09-12T02:34:21.893 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3796352012},{"type":"v1","addr":"172.21.15.119:6833","nonce":3796352012}]},"active_addr":"172.21.15.119:6833/3796352012","active_change":"2024-09-12T02:33:41.169935+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":542367205}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2478148106}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":4251419396}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":332660299}]}]} 2024-09-12T02:34:21.897 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T02:34:21.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:34:21.898 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:21.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.996+0000 7fc84d311640 1 Processor -- start 2024-09-12T02:34:21.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.996+0000 7fc84d311640 1 -- start start 2024-09-12T02:34:22.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc84d311640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc84806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc84d311640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8480b6680 0x7fc8480cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc84d311640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84806e870 con 0x7fc848162060 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc84d311640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc84806d9f0 con 0x7fc8480b6680 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc84d311640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc84806dcd0 con 0x7fc848161c80 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc83ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc848162060 0x7fc8480b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49190/0 (socket says 172.21.15.119:49190) 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc83ffff640 1 -- 172.21.15.119:0/2642314153 learned_addr learned my addr 172.21.15.119:0/2642314153 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc846ffd640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc84806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8477fe640 1 --2- 172.21.15.119:0/2642314153 >> v2:172.21.15.153:3300/0 conn(0x7fc8480b6680 0x7fc8480cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683076354 0 0) 0x7fc830001110 con 0x7fc848162060 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc834003520 con 0x7fc848162060 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274887339 0 0) 0x7fc834003520 con 0x7fc848162060 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 msgr2=0x7fc84806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc84806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 >> v2:172.21.15.153:3300/0 conn(0x7fc8480b6680 msgr2=0x7fc8480cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 --2- 172.21.15.119:0/2642314153 >> v2:172.21.15.153:3300/0 conn(0x7fc8480b6680 0x7fc8480cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84806dfb0 con 0x7fc848162060 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fc830001840 con 0x7fc848162060 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 >> v1:172.21.15.119:6789/0 conn(0x7fc848162060 legacy=0x7fc8480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.997+0000 7fc8467fc640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc834004800 0x7fc834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8467fc640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc8340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc84806d9f0 con 0x7fc8340039b0 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc84806dcd0 con 0x7fc834004800 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc83400b9c0 con 0x7fc848161c80 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc83ffff640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc834004800 0x7fc834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8477fe640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc8340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 -- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 msgr2=0x7fc8340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc8340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 -- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc834004800 msgr2=0x7fc834004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc834004800 0x7fc834004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc846ffd640 1 -- 172.21.15.119:0/2642314153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc834003520 con 0x7fc8340039b0 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.998+0000 7fc8477fe640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc848161c80 0x7fc8340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc846ffd640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc838009ac0 tx=0x7fc834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62edb6ddbd4be23f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838036070 con 0x7fc8340039b0 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc838031400 con 0x7fc8340039b0 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc8467fc640 1 -- 172.21.15.119:0/2642314153 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838009690 con 0x7fc8340039b0 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 -- 172.21.15.119:0/2642314153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 msgr2=0x7fc834003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 --2- 172.21.15.119:0/2642314153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc838009ac0 tx=0x7fc834005830 comp rx=0 tx=0).stop 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc8477fe640 1 -- 172.21.15.119:0/2642314153 reap_dead start 2024-09-12T02:34:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 -- 172.21.15.119:0/2642314153 shutdown_connections 2024-09-12T02:34:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 -- 172.21.15.119:0/2642314153 >> 172.21.15.119:0/2642314153 conn(0x7fc8480d44f0 msgr2=0x7fc8480d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 -- 172.21.15.119:0/2642314153 shutdown_connections 2024-09-12T02:34:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:21.999+0000 7fc84d311640 1 -- 172.21.15.119:0/2642314153 wait complete. 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.000+0000 7fc84d311640 1 Processor -- start 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 -- start start 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8481564c0 0x7fc8480b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 0x7fc8480c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8480b6b30 con 0x7fc8340039b0 2024-09-12T02:34:22.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8480d2aa0 con 0x7fc8480b2320 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc84d311640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc8480b6cb0 con 0x7fc8481564c0 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc846ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc846ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56716/0 (socket says 172.21.15.119:56716) 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.001+0000 7fc846ffd640 1 -- 172.21.15.119:0/825555834 learned_addr learned my addr 172.21.15.119:0/825555834 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 -- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8481564c0 msgr2=0x7fc8480b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc8477fe640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 0x7fc8480c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8481564c0 0x7fc8480b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 -- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 msgr2=0x7fc8480c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 0x7fc8480c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 -- 172.21.15.119:0/825555834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480b8a70 con 0x7fc8340039b0 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc8477fe640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 0x7fc8480c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc846ffd640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc838009ac0 tx=0x7fc838004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838040020 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc838003bc0 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838036040 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8480b8d50 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.002+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8480b9310 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.003+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84806e330 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.003+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc838043020 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.004+0000 7fc83f7fe640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.004+0000 7fc83ffff640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.004+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc8380ab320 con 0x7fc8340039b0 2024-09-12T02:34:22.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.004+0000 7fc83ffff640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 0x7fc82806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc830001eb0 tx=0x7fc830001e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.008+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc83804a070 con 0x7fc8340039b0 2024-09-12T02:34:22.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.177+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8480ba470 con 0x7fc8340039b0 2024-09-12T02:34:22.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.178+0000 7fc83f7fe640 1 -- 172.21.15.119:0/825555834 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7fc8380044e0 con 0x7fc8340039b0 2024-09-12T02:34:22.181 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:22.182 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 msgr2=0x7fc82806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 0x7fc82806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc830001eb0 tx=0x7fc830001e40 comp rx=0 tx=0).stop 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 msgr2=0x7fc8480ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc838009ac0 tx=0x7fc838004730 comp rx=0 tx=0).stop 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 shutdown_connections 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8480b2320 0x7fc8480c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8481564c0 0x7fc8480b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 --2- 172.21.15.119:0/825555834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8340039b0 0x7fc8480ccbf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 >> 172.21.15.119:0/825555834 conn(0x7fc8480d44f0 msgr2=0x7fc84806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 shutdown_connections 2024-09-12T02:34:22.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.181+0000 7fc84d311640 1 -- 172.21.15.119:0/825555834 wait complete. 2024-09-12T02:34:22.193 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:34:22.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:22.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.292+0000 7f4bceb18640 1 Processor -- start 2024-09-12T02:34:22.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.292+0000 7f4bceb18640 1 -- start start 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bceb18640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bc806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bceb18640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc80d2700 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bceb18640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc80cedb0 con 0x7f4bc80cfcc0 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bceb18640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc80cf090 con 0x7f4bc815e760 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4bc80d4fd0 0x7f4bc80cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49196/0 (socket says 172.21.15.119:49196) 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbffff640 1 -- 172.21.15.119:0/2906376767 learned_addr learned my addr 172.21.15.119:0/2906376767 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303797919 0 0) 0x7f4bb8001290 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb0003520 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bc806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3466101095 0 0) 0x7f4bb0003520 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 msgr2=0x7f4bc806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bc806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 >> v1:172.21.15.153:6789/0 conn(0x7f4bc80cfcc0 legacy=0x7f4bc80d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc80b3c80 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f4bb80019e0 con 0x7f4bc80d4fd0 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 >> v1:172.21.15.119:6789/0 conn(0x7f4bc80d4fd0 legacy=0x7f4bc80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bb00039e0 0x7f4bb0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80cf090 con 0x7f4bb00039e0 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0005520 con 0x7f4bb0004800 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb000bf00 con 0x7f4bc815e760 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.293+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bb00039e0 0x7f4bb0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcd0b5640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bbffff640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 -- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 msgr2=0x7f4bb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 -- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb0004800 msgr2=0x7f4bb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 -- 172.21.15.119:0/2906376767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0003520 con 0x7f4bb00039e0 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcd0b5640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc815e760 0x7f4bb000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bbffff640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:22.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.294+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bb00039e0 0x7f4bb0003e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400ba30 tx=0x7f4bb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b495d1755d8072e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4030070 con 0x7f4bb00039e0 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc402ade0 con 0x7f4bb00039e0 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bbf7fe640 1 -- 172.21.15.119:0/2906376767 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400b600 con 0x7f4bb00039e0 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 -- 172.21.15.119:0/2906376767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bb00039e0 msgr2=0x7f4bb0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 --2- 172.21.15.119:0/2906376767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bb00039e0 0x7f4bb0003e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400ba30 tx=0x7f4bb0005830 comp rx=0 tx=0).stop 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bcd0b5640 1 -- 172.21.15.119:0/2906376767 reap_dead start 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 -- 172.21.15.119:0/2906376767 shutdown_connections 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 -- 172.21.15.119:0/2906376767 >> 172.21.15.119:0/2906376767 conn(0x7f4bc808bfc0 msgr2=0x7f4bc80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 -- 172.21.15.119:0/2906376767 shutdown_connections 2024-09-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.295+0000 7f4bceb18640 1 -- 172.21.15.119:0/2906376767 wait complete. 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.296+0000 7f4bceb18640 1 Processor -- start 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.296+0000 7f4bceb18640 1 -- start start 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 0x7f4bc8152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc80b4f00 0x7f4bc80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc806cdd0 con 0x7f4bc80cc030 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80b38a0 con 0x7f4bb00039e0 2024-09-12T02:34:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bceb18640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc806cf50 con 0x7f4bc80b4f00 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bcd0b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bcd0b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56742/0 (socket says 172.21.15.119:56742) 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.297+0000 7f4bcd0b5640 1 -- 172.21.15.119:0/343504533 learned_addr learned my addr 172.21.15.119:0/343504533 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 -- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc80b4f00 msgr2=0x7f4bc80b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc80b4f00 0x7f4bc80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 -- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 msgr2=0x7f4bc8152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 0x7f4bc8152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 0x7f4bc8152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 -- 172.21.15.119:0/343504533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc80ce1a0 con 0x7f4bc80cc030 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 0x7f4bc8152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bcd0b5640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4bc808d8b0 tx=0x7f4bc000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0006b50 con 0x7f4bc80cc030 2024-09-12T02:34:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc0006cf0 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0003970 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc81577b0 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.298+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc8157d70 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.299+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc80b6d20 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.299+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bc001a020 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.300+0000 7f4bbd7fa640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 0x7f4bb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.300+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4bc008a5f0 con 0x7f4bc80cc030 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.300+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 0x7f4bb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.300+0000 7f4bcc8b4640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 0x7f4bb406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400ba00 tx=0x7f4bc4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.304+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bc0006ee0 con 0x7f4bc80cc030 2024-09-12T02:34:22.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.470+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bc80d1c20 con 0x7f4bc80cc030 2024-09-12T02:34:22.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.471+0000 7f4bbd7fa640 1 -- 172.21.15.119:0/343504533 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f4bc0058cf0 con 0x7f4bc80cc030 2024-09-12T02:34:22.472 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:22.472 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 msgr2=0x7f4bb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 0x7f4bb406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400ba00 tx=0x7f4bc4030000 comp rx=0 tx=0).stop 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 msgr2=0x7f4bc80cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4bc808d8b0 tx=0x7f4bc000eb90 comp rx=0 tx=0).stop 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 shutdown_connections 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4bb406be60 0x7f4bb406e320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bc80cc030 0x7f4bc80cc4b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bc80b4f00 0x7f4bc80b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 --2- 172.21.15.119:0/343504533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb00039e0 0x7f4bc8152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 >> 172.21.15.119:0/343504533 conn(0x7f4bc808bfc0 msgr2=0x7f4bc80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 shutdown_connections 2024-09-12T02:34:22.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.473+0000 7f4bceb18640 1 -- 172.21.15.119:0/343504533 wait complete. 2024-09-12T02:34:22.485 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:34:22.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:34:22.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:34:22.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:34:22.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:34:22.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:34:22.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:34:22.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:34:22.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.653+0000 7f1ee359e640 1 Processor -- start 2024-09-12T02:34:22.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.653+0000 7f1ee359e640 1 -- start start 2024-09-12T02:34:22.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7fde49aaf640 1 Processor -- start 2024-09-12T02:34:22.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f743f39f640 1 Processor -- start 2024-09-12T02:34:22.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f743f39f640 1 -- start start 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f6c936dd640 1 Processor -- start 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f6c936dd640 1 -- start start 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f1ee359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ee4073860 0x7f1ee406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f1ee359e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ee406f650 0x7f1ee40b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f1ee359e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee4071fd0 con 0x7f1ee40b2920 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f1ee359e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee406fa90 con 0x7f1ee4073860 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7f1ee359e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee40722b0 con 0x7f1ee406f650 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ee406f650 0x7f1ee40b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ee406f650 0x7f1ee40b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60616/0 (socket says 172.21.15.119:60616) 2024-09-12T02:34:22.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 -- 172.21.15.119:0/713254771 learned_addr learned my addr 172.21.15.119:0/713254771 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 -- 172.21.15.119:0/713254771 >> v2:172.21.15.119:3300/0 conn(0x7f1ee4073860 msgr2=0x7f1ee406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 --2- 172.21.15.119:0/713254771 >> v2:172.21.15.119:3300/0 conn(0x7f1ee4073860 0x7f1ee406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f1ee2d9d640 1 -- 172.21.15.119:0/713254771 >> v1:172.21.15.119:6789/0 conn(0x7f1ee40b2920 legacy=0x7f1ee415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f1ee2d9d640 1 -- 172.21.15.119:0/713254771 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee4072590 con 0x7f1ee406f650 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7fdc3b1df640 1 Processor -- start 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f864a88d640 1 Processor -- start 2024-09-12T02:34:22.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7f864a88d640 1 -- start start 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f743f39f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f743815e880 0x7f743806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.655+0000 7fde49aaf640 1 -- start start 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde49aaf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde4415e4e0 0x7fde440cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde49aaf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 0x7fde440b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde49aaf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde440d4f60 con 0x7fde440d3080 2024-09-12T02:34:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde49aaf640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fde440d0130 con 0x7fde440d2c60 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde49aaf640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fde440d2180 con 0x7fde4415e4e0 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f743d13b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f743806f7a0 0x7f74380720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49226/0 (socket says 172.21.15.119:49226) 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f6c936dd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6c8c09ca20 0x7f6c8c166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f6c936dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f6c936dd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0cf700 con 0x7f6c8c1676a0 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f6c936dd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8c0d0310 con 0x7f6c8c09ca20 2024-09-12T02:34:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f6c936dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cf9e0 con 0x7f6c8c09ce00 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde42ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 0x7fde440b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde42ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 0x7fde440b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56758/0 (socket says 172.21.15.119:56758) 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fde42ffd640 1 -- 172.21.15.119:0/865803255 learned_addr learned my addr 172.21.15.119:0/865803255 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.656+0000 7fdc3b1df640 1 -- start start 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3b1df640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdc3415ea90 0x7fdc340cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3b1df640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc340ce620 con 0x7fdc3415a2c0 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3b1df640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc340ce8c0 con 0x7fdc340720b0 2024-09-12T02:34:22.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3b1df640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdc340ce3f0 con 0x7fdc3415ea90 2024-09-12T02:34:22.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7fd46a2f0640 1 Processor -- start 2024-09-12T02:34:22.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f6c90c78640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f6c90c78640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:52500/0 (socket says 172.21.15.119:52500) 2024-09-12T02:34:22.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f6c90c78640 1 -- 172.21.15.119:0/2546301079 learned_addr learned my addr 172.21.15.119:0/2546301079 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f864a88d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f864415c870 0x7f864415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.657+0000 7f743c93a640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f74380727c0 0x7f743815e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:48338/0 (socket says 172.21.15.119:48338) 2024-09-12T02:34:22.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f743d13b640 1 -- 172.21.15.119:0/3851525642 learned_addr learned my addr 172.21.15.119:0/3851525642 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380b44e0 con 0x7f743806f7a0 2024-09-12T02:34:22.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743815ab60 con 0x7f74380727c0 2024-09-12T02:34:22.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f1ee2d9d640 1 --2- 172.21.15.119:0/713254771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee40b3340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40cfff0 tx=0x7f1ed802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed7d5f3bcdfd0116 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f86437fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f864415c870 0x7f864415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f86437fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f864415c870 0x7f864415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56770/0 (socket says 172.21.15.119:56770) 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f86437fe640 1 -- 172.21.15.119:0/3980237050 learned_addr learned my addr 172.21.15.119:0/3980237050 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f864a88d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86440d01c0 con 0x7f864415c490 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fd46a2f0640 1 -- start start 2024-09-12T02:34:22.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86440d04a0 con 0x7f86440ccf90 2024-09-12T02:34:22.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f86440cff70 con 0x7f864415c870 2024-09-12T02:34:22.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3977c640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdc340720b0 0x7fdc340b34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:48362/0 (socket says 172.21.15.119:48362) 2024-09-12T02:34:22.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc3977c640 1 -- 172.21.15.119:0/2578799190 learned_addr learned my addr 172.21.15.119:0/2578799190 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f6c91479640 1 --2- 172.21.15.119:0/2546301079 >> v2:172.21.15.119:3300/0 conn(0x7f6c8c09ca20 0x7f6c8c166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f743815eea0 con 0x7f743815e880 2024-09-12T02:34:22.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f743d93c640 1 --2- 172.21.15.119:0/3851525642 >> v2:172.21.15.119:3300/0 conn(0x7f743815e880 0x7f743806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453938270 0 0) 0x7f74380b44e0 con 0x7f743806f7a0 2024-09-12T02:34:22.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fdc33fff640 1 --2- 172.21.15.119:0/2578799190 >> v2:172.21.15.119:3300/0 conn(0x7fdc3415ea90 0x7fdc340cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7424003520 con 0x7f743806f7a0 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850567274 0 0) 0x7f743815ab60 con 0x7f74380727c0 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74380b44e0 con 0x7f74380727c0 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f6c90c78640 1 -- 172.21.15.119:0/2546301079 >> v2:172.21.15.119:3300/0 conn(0x7f6c8c09ca20 msgr2=0x7f6c8c166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f6c90c78640 1 --2- 172.21.15.119:0/2546301079 >> v2:172.21.15.119:3300/0 conn(0x7f6c8c09ca20 0x7f6c8c166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f6c90c78640 1 -- 172.21.15.119:0/2546301079 >> v1:172.21.15.153:6789/0 conn(0x7f6c8c1676a0 legacy=0x7f6c8c0d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f6c90c78640 1 -- 172.21.15.119:0/2546301079 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0cfcc0 con 0x7f6c8c09ce00 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fde437fe640 1 --2- 172.21.15.119:0/865803255 >> v2:172.21.15.153:3300/0 conn(0x7fde4415e4e0 0x7fde440cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fde437fe640 1 -- 172.21.15.119:0/865803255 >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 msgr2=0x7fde440b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fde437fe640 1 --2- 172.21.15.119:0/865803255 >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 0x7fde440b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fde437fe640 1 -- 172.21.15.119:0/865803255 >> v1:172.21.15.119:6789/0 conn(0x7fde440d3080 legacy=0x7fde44162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.658+0000 7fde437fe640 1 -- 172.21.15.119:0/865803255 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde440d2460 con 0x7fde4415e4e0 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f1ee159a640 1 -- 172.21.15.119:0/713254771 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8037070 con 0x7f1ee406f650 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f1ee159a640 1 -- 172.21.15.119:0/713254771 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8032440 con 0x7f1ee406f650 2024-09-12T02:34:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2046060165 0 0) 0x7f74380b44e0 con 0x7f74380727c0 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 >> v2:172.21.15.119:3300/0 conn(0x7f743815e880 msgr2=0x7f743806fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 --2- 172.21.15.119:0/3851525642 >> v2:172.21.15.119:3300/0 conn(0x7f743815e880 0x7f743806fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 >> v1:172.21.15.119:6789/0 conn(0x7f743806f7a0 legacy=0x7f74380720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743815ae40 con 0x7f74380727c0 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f7434001670 con 0x7f74380727c0 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 >> v1:172.21.15.153:6789/0 conn(0x7f74380727c0 legacy=0x7f743815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7424004ba0 0x7f7424004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74240037a0 0x7f7424003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f742400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f743815eea0 con 0x7f7424004ba0 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74240148f0 con 0x7f74240037a0 2024-09-12T02:34:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7424014af0 con 0x7f7424004160 2024-09-12T02:34:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fa0f76e6640 1 Processor -- start 2024-09-12T02:34:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f743c93a640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74240037a0 0x7f7424003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f743d93c640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f742400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199315182 0 0) 0x7f86440d01c0 con 0x7f864415c490 2024-09-12T02:34:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f862c003520 con 0x7f864415c490 2024-09-12T02:34:22.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fa0f76e6640 1 -- start start 2024-09-12T02:34:22.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701056110 0 0) 0x7fdc340ce8c0 con 0x7fdc340720b0 2024-09-12T02:34:22.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc20003520 con 0x7fdc340720b0 2024-09-12T02:34:22.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789815012 0 0) 0x7fdc20003520 con 0x7fdc340720b0 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 >> v2:172.21.15.119:3300/0 conn(0x7fdc3415ea90 msgr2=0x7fdc340cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 --2- 172.21.15.119:0/2578799190 >> v2:172.21.15.119:3300/0 conn(0x7fdc3415ea90 0x7fdc340cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 >> v1:172.21.15.119:6789/0 conn(0x7fdc3415a2c0 legacy=0x7fdc340cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc340ceba0 con 0x7fdc340720b0 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fdc2c005150 con 0x7fdc340720b0 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 >> v1:172.21.15.153:6789/0 conn(0x7fdc340720b0 legacy=0x7fdc340b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 0x7fdc20003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20004800 0x7fdc20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc200051c0 0x7fdc2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2000c090 con 0x7fdc20004800 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2000c240 con 0x7fdc200051c0 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2000c440 con 0x7fdc20003a00 2024-09-12T02:34:22.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 0x7fdc20003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee159a640 1 -- 172.21.15.119:0/713254771 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8032810 con 0x7f1ee406f650 2024-09-12T02:34:22.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298930437 0 0) 0x7f86440d04a0 con 0x7f86440ccf90 2024-09-12T02:34:22.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86440d01c0 con 0x7f86440ccf90 2024-09-12T02:34:22.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 -- 172.21.15.119:0/713254771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 msgr2=0x7f1ee40b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 --2- 172.21.15.119:0/713254771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee40b3340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40cfff0 tx=0x7f1ed802a2c0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f6c90c78640 1 --2- 172.21.15.119:0/2546301079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009e50 tx=0x7f6c8402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f7d32dbeb5fcb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1726932863 0 0) 0x7f862c003520 con 0x7f864415c490 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 >> v2:172.21.15.119:3300/0 conn(0x7f864415c870 msgr2=0x7f864415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 --2- 172.21.15.119:0/3980237050 >> v2:172.21.15.119:3300/0 conn(0x7f864415c870 0x7f864415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 >> v1:172.21.15.153:6789/0 conn(0x7f86440ccf90 legacy=0x7f86440cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86440d0780 con 0x7f864415c490 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f8634001670 con 0x7f864415c490 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 >> v1:172.21.15.119:6789/0 conn(0x7f864415c490 legacy=0x7f864409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fd46a2f0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd46406f820 0x7fd4640ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fd46a2f0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640ce180 con 0x7fd46415c040 2024-09-12T02:34:22.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fd46a2f0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640ce460 con 0x7fd4640cdae0 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 -- 172.21.15.119:0/713254771 shutdown_connections 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 --2- 172.21.15.119:0/713254771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee40b3340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.659+0000 7fd46a2f0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd464072c50 con 0x7fd46406f820 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fd468aed640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd4640cdae0 0x7fd46406f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:48374/0 (socket says 172.21.15.119:48374) 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fd468aed640 1 -- 172.21.15.119:0/3244761976 learned_addr learned my addr 172.21.15.119:0/3244761976 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 --2- 172.21.15.119:0/713254771 >> v2:172.21.15.119:3300/0 conn(0x7f1ee4073860 0x7f1ee406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 -- 172.21.15.119:0/713254771 >> 172.21.15.119:0/713254771 conn(0x7f1ee40b1e00 msgr2=0x7f1ee40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f862c003b40 0x7f862c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fdc3977c640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc200051c0 0x7fdc2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f6c83fff640 1 -- 172.21.15.119:0/2546301079 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84036070 con 0x7f6c8c09ce00 2024-09-12T02:34:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f6c83fff640 1 -- 172.21.15.119:0/2546301079 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84031600 con 0x7f6c8c09ce00 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f6c83fff640 1 -- 172.21.15.119:0/2546301079 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84036070 con 0x7f6c8c09ce00 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f1ee359e640 1 -- 172.21.15.119:0/713254771 shutdown_connections 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f862c0051c0 0x7f862c00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f86440cff70 con 0x7f862c004800 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f862c010390 con 0x7f862c0051c0 2024-09-12T02:34:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f862c010590 con 0x7f862c003b40 2024-09-12T02:34:22.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fd469aef640 1 --2- 172.21.15.119:0/3244761976 >> v2:172.21.15.119:3300/0 conn(0x7fd46406f820 0x7fd4640ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f743d93c640 1 -- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74240037a0 msgr2=0x7f7424003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f743d93c640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74240037a0 0x7f7424003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7fde437fe640 1 --2- 172.21.15.119:0/865803255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde440cfac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde440b6f50 tx=0x7fde3c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1216e0b2efd293e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f743d13b640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7424004ba0 0x7f7424004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f743d93c640 1 -- 172.21.15.119:0/3851525642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7424004ba0 msgr2=0x7f7424004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f743d93c640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7424004ba0 0x7f7424004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f743d93c640 1 -- 172.21.15.119:0/3851525642 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743815ae40 con 0x7f7424004160 2024-09-12T02:34:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc33fff640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20004800 0x7fdc20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.660+0000 7f86437fe640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f8648e2a640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f862c0051c0 0x7f862c00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f8643fff640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f862c003b40 0x7f862c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f743d13b640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7424004ba0 0x7f7424004fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fde427fc640 1 -- 172.21.15.119:0/865803255 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c007740 con 0x7fde4415e4e0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fde427fc640 1 -- 172.21.15.119:0/865803255 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c0078e0 con 0x7fde4415e4e0 2024-09-12T02:34:22.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fde427fc640 1 -- 172.21.15.119:0/865803255 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c007cf0 con 0x7fde4415e4e0 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc38f7b640 1 -- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc200051c0 msgr2=0x7fdc2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc200051c0 0x7fdc2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc38f7b640 1 -- 172.21.15.119:0/2578799190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20004800 msgr2=0x7fdc20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20004800 0x7fdc20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc38f7b640 1 -- 172.21.15.119:0/2578799190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20003520 con 0x7fdc20003a00 2024-09-12T02:34:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fdc3977c640 1 -- 172.21.15.119:0/2578799190 reap_dead start 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0f015a2c0 0x7fa0f00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 0x7fa0f00cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f00ce3f0 con 0x7fa0f015ea90 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f0072a40 con 0x7fa0f015a2c0 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f76e6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f00cf1f0 con 0x7fa0f00720b0 2024-09-12T02:34:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f5c83640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f86437fe640 1 -- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f862c003b40 msgr2=0x7f862c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f86437fe640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f862c003b40 0x7f862c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f86437fe640 1 -- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f862c0051c0 msgr2=0x7f862c00fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f86437fe640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f862c0051c0 0x7f862c00fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f86437fe640 1 -- 172.21.15.119:0/3980237050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86440d01c0 con 0x7f862c004800 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f5c83640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:52526/0 (socket says 172.21.15.119:52526) 2024-09-12T02:34:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7fa0f5c83640 1 -- 172.21.15.119:0/3022527483 learned_addr learned my addr 172.21.15.119:0/3022527483 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f743d93c640 1 -- 172.21.15.119:0/3851525642 reap_dead start 2024-09-12T02:34:22.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 -- 172.21.15.119:0/2546301079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 msgr2=0x7f6c8c167160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 --2- 172.21.15.119:0/2546301079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009e50 tx=0x7f6c8402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f4c81640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 0x7fa0f00cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fd469aef640 1 -- 172.21.15.119:0/3244761976 >> v1:172.21.15.153:6789/0 conn(0x7fd4640cdae0 legacy=0x7fd46406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fd469aef640 1 -- 172.21.15.119:0/3244761976 >> v1:172.21.15.119:6789/0 conn(0x7fd46415c040 legacy=0x7fd464072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fd469aef640 1 -- 172.21.15.119:0/3244761976 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd464071d40 con 0x7fd46406f820 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f5c83640 1 -- 172.21.15.119:0/3022527483 >> v2:172.21.15.153:3300/0 conn(0x7fa0f015a2c0 msgr2=0x7fa0f00cc9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.153:3300/0 conn(0x7fa0f015a2c0 0x7fa0f00cc9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f5c83640 1 -- 172.21.15.119:0/3022527483 >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 msgr2=0x7fa0f00cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 -- 172.21.15.119:0/2546301079 shutdown_connections 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 --2- 172.21.15.119:0/2546301079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c09ce00 0x7f6c8c167160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 --2- 172.21.15.119:0/2546301079 >> v2:172.21.15.119:3300/0 conn(0x7f6c8c09ca20 0x7f6c8c166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 -- 172.21.15.119:0/2546301079 >> 172.21.15.119:0/2546301079 conn(0x7f6c8c0d11f0 msgr2=0x7f6c8c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f743d93c640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f742400b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7428009ac0 tx=0x7f7424005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4fda9afff2d223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f8648e2a640 1 -- 172.21.15.119:0/3980237050 reap_dead start 2024-09-12T02:34:22.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 0x7fdc20003e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c001750 tx=0x7fdc20005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90695adaa7f47255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428009690 con 0x7f7424004160 2024-09-12T02:34:22.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.661+0000 7f1ee359e640 1 -- 172.21.15.119:0/713254771 wait complete. 2024-09-12T02:34:22.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f86437fe640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f862c004c80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8638009bf0 tx=0x7f862c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0a3ba50d7e1ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428004020 con 0x7f7424004160 2024-09-12T02:34:22.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f742ffff640 1 -- 172.21.15.119:0/3851525642 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428009690 con 0x7f7424004160 2024-09-12T02:34:22.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 -- 172.21.15.119:0/2546301079 shutdown_connections 2024-09-12T02:34:22.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7f6c936dd640 1 -- 172.21.15.119:0/2546301079 wait complete. 2024-09-12T02:34:22.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 0x7fa0f00cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fa0f5c83640 1 -- 172.21.15.119:0/3022527483 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f00ce620 con 0x7fa0f00720b0 2024-09-12T02:34:22.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f1ee359e640 1 Processor -- start 2024-09-12T02:34:22.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fa0f4c81640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 0x7fa0f00cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:22.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 -- 172.21.15.119:0/865803255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 msgr2=0x7fde440cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 --2- 172.21.15.119:0/865803255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde440cfac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde440b6f50 tx=0x7fde3c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f1ee359e640 1 -- start start 2024-09-12T02:34:22.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fd469aef640 1 --2- 172.21.15.119:0/3244761976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd46406f820 0x7fd4640ccae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4540097d0 tx=0x7fd45402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55fb136e55b2622 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 -- 172.21.15.119:0/865803255 shutdown_connections 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 --2- 172.21.15.119:0/865803255 >> v2:172.21.15.119:3300/0 conn(0x7fde440d2c60 0x7fde440b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 --2- 172.21.15.119:0/865803255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde440cfac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 -- 172.21.15.119:0/865803255 >> 172.21.15.119:0/865803255 conn(0x7fde4408bfc0 msgr2=0x7fde440d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c001370 con 0x7fdc20003a00 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0050d0 con 0x7fdc20003a00 2024-09-12T02:34:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.662+0000 7fdc337fe640 1 -- 172.21.15.119:0/2578799190 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0035f0 con 0x7fdc20003a00 2024-09-12T02:34:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638040070 con 0x7f862c004800 2024-09-12T02:34:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638033780 con 0x7f862c004800 2024-09-12T02:34:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 msgr2=0x7f742400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 -- 172.21.15.119:0/865803255 shutdown_connections 2024-09-12T02:34:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f743f39f640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f742400b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7428009ac0 tx=0x7f7424005830 comp rx=0 tx=0).stop 2024-09-12T02:34:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fdc3b1df640 1 -- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 msgr2=0x7fdc20003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fdc3b1df640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 0x7fdc20003e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c001750 tx=0x7fdc20005830 comp rx=0 tx=0).stop 2024-09-12T02:34:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fd45bfff640 1 -- 172.21.15.119:0/3244761976 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd46406f820 2024-09-12T02:34:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f8642ffd640 1 -- 172.21.15.119:0/3980237050 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380097c0 con 0x7f862c004800 2024-09-12T02:34:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fd45bfff640 1 -- 172.21.15.119:0/3244761976 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454032440 con 0x7fd46406f820 2024-09-12T02:34:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 shutdown_connections 2024-09-12T02:34:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fd45bfff640 1 -- 172.21.15.119:0/3244761976 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454032810 con 0x7fd46406f820 2024-09-12T02:34:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fdc3b1df640 1 -- 172.21.15.119:0/2578799190 shutdown_connections 2024-09-12T02:34:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fdc3b1df640 1 --2- 172.21.15.119:0/2578799190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc20003a00 0x7fdc20003e20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fdc3b1df640 1 -- 172.21.15.119:0/2578799190 >> 172.21.15.119:0/2578799190 conn(0x7fdc34067b30 msgr2=0x7fdc3406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f743f39f640 1 --2- 172.21.15.119:0/3851525642 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f742400b9c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 >> 172.21.15.119:0/3851525642 conn(0x7f7438067b30 msgr2=0x7f743806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fdc3b1df640 1 -- 172.21.15.119:0/2578799190 shutdown_connections 2024-09-12T02:34:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fdc3b1df640 1 -- 172.21.15.119:0/2578799190 wait complete. 2024-09-12T02:34:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/3022527483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0f006c800 tx=0x7fa0ec02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2395ddeb79e25060 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f6c936dd640 1 Processor -- start 2024-09-12T02:34:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f6c936dd640 1 -- start start 2024-09-12T02:34:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f1ee359e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee41577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f1ee359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 0x7f1ee4203720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fa0e7fff640 1 -- 172.21.15.119:0/3022527483 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec037070 con 0x7fa0f00720b0 2024-09-12T02:34:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fa0e7fff640 1 -- 172.21.15.119:0/3022527483 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ec032440 con 0x7fa0f00720b0 2024-09-12T02:34:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fa0e7fff640 1 -- 172.21.15.119:0/3022527483 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec037070 con 0x7fa0f00720b0 2024-09-12T02:34:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.663+0000 7fde49aaf640 1 -- 172.21.15.119:0/865803255 wait complete. 2024-09-12T02:34:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 msgr2=0x7f862c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f864a88d640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f862c004c80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8638009bf0 tx=0x7f862c005830 comp rx=0 tx=0).stop 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7fd46a2f0640 1 -- 172.21.15.119:0/3244761976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd46406f820 msgr2=0x7fd4640ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 --2- 172.21.15.119:0/3244761976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd46406f820 0x7fd4640ccae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4540097d0 tx=0x7fd45402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.664+0000 7f1ee1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 0x7f1ee4203720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee41577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee41577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60662/0 (socket says 172.21.15.119:60662) 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 0x7f1ee4203720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56852/0 (socket says 172.21.15.119:56852) 2024-09-12T02:34:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 -- 172.21.15.119:0/1009586040 learned_addr learned my addr 172.21.15.119:0/1009586040 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 -- 172.21.15.119:0/3244761976 shutdown_connections 2024-09-12T02:34:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 --2- 172.21.15.119:0/3244761976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd46406f820 0x7fd4640ccae0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee359e640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ee40b2920 0x7f1ee41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 -- 172.21.15.119:0/3244761976 >> 172.21.15.119:0/3244761976 conn(0x7fd4640b1e00 msgr2=0x7fd4640b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee40cfd10 con 0x7f1ee4073860 2024-09-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 shutdown_connections 2024-09-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4072b50 con 0x7f1ee406f650 2024-09-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f743f39f640 1 -- 172.21.15.119:0/3851525642 wait complete. 2024-09-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee4073cd0 con 0x7f1ee40b2920 2024-09-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 shutdown_connections 2024-09-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f864a88d640 1 --2- 172.21.15.119:0/3980237050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 >> 172.21.15.119:0/3980237050 conn(0x7f86440d23a0 msgr2=0x7f86440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 0x7f6c8c1f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c8c09ce00 0x7f6c8c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c1676a0 0x7f6c8c1f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 -- 172.21.15.119:0/3244761976 shutdown_connections 2024-09-12T02:34:22.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c073470 con 0x7f6c8c09ce00 2024-09-12T02:34:22.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fd46a2f0640 1 -- 172.21.15.119:0/3244761976 wait complete. 2024-09-12T02:34:22.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0732f0 con 0x7f6c8c09ca20 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 -- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ee40b2920 msgr2=0x7f1ee41561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ee40b2920 0x7f1ee41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 -- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 msgr2=0x7f1ee4203720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 0x7f1ee4203720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee259c640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee415a060 con 0x7f1ee406f650 2024-09-12T02:34:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c936dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0737d0 con 0x7f6c8c1676a0 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 -- 172.21.15.119:0/3022527483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 msgr2=0x7fa0f0072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 --2- 172.21.15.119:0/3022527483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0f006c800 tx=0x7fa0ec02a230 comp rx=0 tx=0).stop 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 -- 172.21.15.119:0/3022527483 shutdown_connections 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 --2- 172.21.15.119:0/3022527483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f0072500 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.119:3300/0 conn(0x7fa0f015ea90 0x7fa0f00cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 --2- 172.21.15.119:0/3022527483 >> v2:172.21.15.153:3300/0 conn(0x7fa0f015a2c0 0x7fa0f00cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fa0f76e6640 1 -- 172.21.15.119:0/3022527483 >> 172.21.15.119:0/3022527483 conn(0x7fa0f0067b30 msgr2=0x7fa0f006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c91c7a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c1676a0 0x7f6c8c1f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f1ee1d9b640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee4073860 0x7f1ee4203720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:22.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7fde49aaf640 1 Processor -- start 2024-09-12T02:34:22.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7fde49aaf640 1 -- start start 2024-09-12T02:34:22.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 shutdown_connections 2024-09-12T02:34:22.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c91479640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 0x7f6c8c1f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f864a88d640 1 -- 172.21.15.119:0/3980237050 wait complete. 2024-09-12T02:34:22.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c91479640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 0x7f6c8c1f92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60666/0 (socket says 172.21.15.119:60666) 2024-09-12T02:34:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.665+0000 7f6c91479640 1 -- 172.21.15.119:0/4158687543 learned_addr learned my addr 172.21.15.119:0/4158687543 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c90c78640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c8c09ce00 0x7f6c8c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c91479640 1 -- 172.21.15.119:0/4158687543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c1676a0 msgr2=0x7f6c8c1f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f1ee259c640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee41577a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400b3e0 tx=0x7f1ed400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c91479640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c8c1676a0 0x7f6c8c1f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c91479640 1 -- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c8c09ce00 msgr2=0x7f6c8c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c91479640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c8c09ce00 0x7f6c8c0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4015020 con 0x7f1ee406f650 2024-09-12T02:34:22.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c91479640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0ce300 con 0x7f6c8c09ca20 2024-09-12T02:34:22.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f6c90c78640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c8c09ce00 0x7f6c8c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:22.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee415a340 con 0x7f1ee406f650 2024-09-12T02:34:22.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee4154520 con 0x7f1ee406f650 2024-09-12T02:34:22.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7fdc3b1df640 1 Processor -- start 2024-09-12T02:34:22.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed4011850 con 0x7f1ee406f650 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4011c40 con 0x7f1ee406f650 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7f743f39f640 1 Processor -- start 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde440d2c60 0x7fde44152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 0x7fde440caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde441fc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fde4415ea40 con 0x7fde440d3080 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fde4415e8c0 con 0x7fde4415e4e0 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde49aaf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fde440b77a0 con 0x7fde440d2c60 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 0x7fde440caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde43fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde441fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 0x7fde440caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56872/0 (socket says 172.21.15.119:56872) 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 -- 172.21.15.119:0/4254469007 learned_addr learned my addr 172.21.15.119:0/4254469007 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7f743f39f640 1 -- start start 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 -- 172.21.15.119:0/4254469007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde440d2c60 msgr2=0x7fde44152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde440d2c60 0x7fde44152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 -- 172.21.15.119:0/4254469007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 msgr2=0x7fde441fc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde4415e4e0 0x7fde441fc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fde42ffd640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4415bbf0 con 0x7fde440d3080 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fde42ffd640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 0x7fde440caa50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde3800e810 tx=0x7fde3800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fd46a2f0640 1 Processor -- start 2024-09-12T02:34:22.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f864a88d640 1 Processor -- start 2024-09-12T02:34:22.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38017070 con 0x7fde440d3080 2024-09-12T02:34:22.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fd46a2f0640 1 -- start start 2024-09-12T02:34:22.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7fa0f76e6640 1 -- 172.21.15.119:0/3022527483 shutdown_connections 2024-09-12T02:34:22.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.666+0000 7fa0f76e6640 1 -- 172.21.15.119:0/3022527483 wait complete. 2024-09-12T02:34:22.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fa0f76e6640 1 Processor -- start 2024-09-12T02:34:22.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fa0f76e6640 1 -- start start 2024-09-12T02:34:22.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.667+0000 7fdc3b1df640 1 -- start start 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20003a00 0x7fdc3414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc341f9850 0x7fdc3414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 0x7fdc341f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3415a6a0 con 0x7fdc20003a00 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc340cf1f0 con 0x7fdc3414ec20 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3b1df640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3415a820 con 0x7fdc341f9850 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f864a88d640 1 -- start start 2024-09-12T02:34:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f6c91479640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 0x7f6c8c1f92a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800d5f0 tx=0x7f6c8800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3977c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 0x7fdc341f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ec8001030 con 0x7f1ee406f650 2024-09-12T02:34:22.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3977c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 0x7fdc341f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60672/0 (socket says 172.21.15.119:60672) 2024-09-12T02:34:22.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fdc3977c640 1 -- 172.21.15.119:0/649847407 learned_addr learned my addr 172.21.15.119:0/649847407 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f7438155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74381559f0 0x7f743814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74380b1980 0x7f74380b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f743815b900 con 0x7f74380b1980 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f743815b400 con 0x7f74381559f0 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7f743f39f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f743806c320 con 0x7f7424004160 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743d93c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74380b1980 0x7f74380b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743d93c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74380b1980 0x7f74380b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56880/0 (socket says 172.21.15.119:56880) 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743d93c640 1 -- 172.21.15.119:0/3384771493 learned_addr learned my addr 172.21.15.119:0/3384771493 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74381559f0 0x7f743814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743d13b640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f7438155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f00c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015a2c0 0x7fa0f02048c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0f015ea90 0x7fa0f00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f00cee80 con 0x7fa0f015ea90 2024-09-12T02:34:22.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f00ceba0 con 0x7fa0f015a2c0 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f76e6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f00ccf20 con 0x7fa0f00720b0 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f5482640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f00c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f5482640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f00c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:52568/0 (socket says 172.21.15.119:52568) 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fa0f5482640 1 -- 172.21.15.119:0/2414517171 learned_addr learned my addr 172.21.15.119:0/2414517171 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fde49aaf640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4415be90 con 0x7fde440d3080 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.668+0000 7fde49aaf640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4415c450 con 0x7fde440d3080 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3800c8d0 con 0x7fde440d3080 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3800f040 con 0x7fde440d3080 2024-09-12T02:34:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7fde49aaf640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde440b7b60 con 0x7fde440d3080 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 -- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 msgr2=0x7f7438155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7424004160 0x7f7438155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 -- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74380b1980 msgr2=0x7f74380b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74380b1980 0x7f74380b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.669+0000 7f743c93a640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438152620 con 0x7f74381559f0 2024-09-12T02:34:22.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20003a00 0x7fdc3414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f743c93a640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74381559f0 0x7f743814df70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74340077e0 tx=0x7f7434004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f864a88d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f8644156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880125f0 con 0x7f6c8c09ca20 2024-09-12T02:34:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c88019070 con 0x7f6c8c09ca20 2024-09-12T02:34:22.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd46406f820 0x7fd464142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 0x7fd46415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f864a88d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8644158010 0x7f8644149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880129d0 con 0x7f6c8c09ca20 2024-09-12T02:34:22.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c0cb670 con 0x7f6c8c09ca20 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fdc33fff640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc341f9850 0x7fdc3414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd46415c040 0x7fd46415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743400f940 con 0x7f74381559f0 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7438152900 con 0x7f74381559f0 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7438155fb0 con 0x7f74381559f0 2024-09-12T02:34:22.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7434018070 con 0x7f74381559f0 2024-09-12T02:34:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743400fd20 con 0x7f74381559f0 2024-09-12T02:34:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c0cbc30 con 0x7f6c8c09ca20 2024-09-12T02:34:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ed4018020 con 0x7f1ee406f650 2024-09-12T02:34:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f8643fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f8644156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f8643fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f8644156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56898/0 (socket says 172.21.15.119:56898) 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7f864a88d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86440b0f20 0x7f86440b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f86437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8644158010 0x7f8644149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f86437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8644158010 0x7f8644149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60708/0 (socket says 172.21.15.119:60708) 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640ce740 con 0x7fd4640cdae0 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640cdf30 con 0x7fd46406f820 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd46a2f0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd46415c420 con 0x7fd46415c040 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd4692ee640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd46406f820 0x7fd464142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd468aed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 0x7fd46415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd468aed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 0x7fd46415a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56906/0 (socket says 172.21.15.119:56906) 2024-09-12T02:34:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd468aed640 1 -- 172.21.15.119:0/116424623 learned_addr learned my addr 172.21.15.119:0/116424623 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fd469aef640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd46415c040 0x7fd46415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f8643fff640 1 -- 172.21.15.119:0/1048344453 learned_addr learned my addr 172.21.15.119:0/1048344453 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:22.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f8648e2a640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86440b0f20 0x7f86440b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f86440d1260 con 0x7f862c004800 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.670+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0f015ea90 0x7fa0f00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f4c81640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015a2c0 0x7fa0f02048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 -- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015a2c0 msgr2=0x7fa0f02048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86440d0dd0 con 0x7f8644158010 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015a2c0 0x7fa0f02048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 -- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0f015ea90 msgr2=0x7fa0f00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0f015ea90 0x7fa0f00c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8644158470 con 0x7f86440b0f20 2024-09-12T02:34:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f00c5ca0 con 0x7fa0f00720b0 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 -- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc341f9850 msgr2=0x7fdc3414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc341f9850 0x7fdc3414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 -- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 msgr2=0x7fdc341f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 0x7fdc341f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3414bd40 con 0x7fdc20003a00 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc3977c640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc3414ec20 0x7fdc341f8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fdc38f7b640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20003a00 0x7fdc3414b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c610 tx=0x7fdc1c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7fa0f5482640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f00c6d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000b450 tx=0x7fa0e000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7438152e20 con 0x7f74381559f0 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.671+0000 7f1ed2ffd640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1ec406be30 0x7f1ec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1ed408af90 con 0x7f1ee406f650 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f1ed2ffd640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7f1ec40755b0 0x7f1ec40779f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ed4004450 con 0x7f1ec40755b0 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ed408d5f0 con 0x7f1ee406f650 2024-09-12T02:34:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f1ee1d9b640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1ec406be30 0x7f1ec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0021070 con 0x7fa0f00720b0 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 -- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86440b0f20 msgr2=0x7f86440b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86440b0f20 0x7f86440b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 -- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8644158010 msgr2=0x7f8644149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8644158010 0x7f8644149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8644149cb0 con 0x7f862c004800 2024-09-12T02:34:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f8643fff640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f8644156990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f863400f860 tx=0x7f863400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f1ee2d9d640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7f1ec40755b0 0x7f1ec40779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 -- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd46415c040 msgr2=0x7fd46415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd46415c040 0x7fd46415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 -- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd46406f820 msgr2=0x7fd464142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd46406f820 0x7fd464142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46415f4a0 con 0x7fd4640cdae0 2024-09-12T02:34:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd468aed640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 0x7fd46415a680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c4d0 tx=0x7fd46000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460017070 con 0x7fd4640cdae0 2024-09-12T02:34:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fd46a2f0640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd464149fa0 con 0x7fd4640cdae0 2024-09-12T02:34:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fd46a2f0640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4640b4cb0 con 0x7fd4640cdae0 2024-09-12T02:34:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f1ee1d9b640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1ec406be30 0x7f1ec406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40b4780 tx=0x7f1edc00d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f743401d460 con 0x7f74381559f0 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde3801a070 con 0x7fde440d3080 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde2ffff640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde2806bf00 0x7fde2806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fde3808ad10 con 0x7fde440d3080 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde2ffff640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde28075670 0x7fde28077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c88012b70 con 0x7f6c8c09ca20 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c6c001030 con 0x7f6c8c09ca20 2024-09-12T02:34:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f6c81ffb640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6c7006bf00 0x7f6c7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde437fe640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde2806bf00 0x7fde2806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde3800fe50 con 0x7fde28075670 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fde3808d370 con 0x7fde440d3080 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fde43fff640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde28075670 0x7fde28077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6c8808b570 con 0x7f6c8c09ca20 2024-09-12T02:34:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f6c81ffb640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f6c70075670 0x7f6c70077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c88001d30 con 0x7f6c70075670 2024-09-12T02:34:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f1ee2d9d640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7f1ec40755b0 0x7f1ec40779f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6c88092050 con 0x7f6c8c09ca20 2024-09-12T02:34:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460005ce0 con 0x7fd4640cdae0 2024-09-12T02:34:22.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7f742dffb640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f741c06be60 0x7f741c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f743408b100 con 0x7f74381559f0 2024-09-12T02:34:22.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c043070 con 0x7fdc20003a00 2024-09-12T02:34:22.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7fde43fff640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde28075670 0x7fde28077ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c003e10 con 0x7fdc20003a00 2024-09-12T02:34:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7f743d13b640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f741c06be60 0x7f741c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fa0f76e6640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f00c5f80 con 0x7fa0f00720b0 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.672+0000 7fa0f76e6640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f00c6540 con 0x7fa0f00720b0 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.673+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e001c440 con 0x7fa0f00720b0 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e001c830 con 0x7fa0f00720b0 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7f742dffb640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7f741c0755e0 0x7f741c077a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== osd.3 v2:172.21.15.119:6824/2158673929 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ed4004450 con 0x7f1ec40755b0 2024-09-12T02:34:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460007270 con 0x7fd4640cdae0 2024-09-12T02:34:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86340050d0 con 0x7f862c004800 2024-09-12T02:34:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.674+0000 7f743d13b640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f741c06be60 0x7f741c06e320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7438075790 tx=0x7f743000a040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f741c0780f0 con 0x7f741c0755e0 2024-09-12T02:34:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7434092050 con 0x7f74381559f0 2024-09-12T02:34:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7fde437fe640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde2806bf00 0x7fde2806e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde3c034000 tx=0x7fde3c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8634005290 con 0x7f862c004800 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863400d940 con 0x7f862c004800 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8644156f70 con 0x7f862c004800 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7fd46a2f0640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd444001030 con 0x7fd4640cdae0 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc341f9530 con 0x7fdc20003a00 2024-09-12T02:34:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3414c2e0 con 0x7fdc20003a00 2024-09-12T02:34:22.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8644157530 con 0x7f862c004800 2024-09-12T02:34:22.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.676+0000 7fa0f76e6640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0d0001030 con 0x7fa0f00720b0 2024-09-12T02:34:22.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f6c91c7a640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f6c70075670 0x7f6c70077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.675+0000 7f6c91c7a640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f6c70075670 0x7f6c70077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.676+0000 7f6c90c78640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6c7006bf00 0x7f6c7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.676+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd46001a070 con 0x7fd4640cdae0 2024-09-12T02:34:22.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.676+0000 7f6c90c78640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6c7006bf00 0x7f6c7006e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c84033000 tx=0x7f6c84009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== osd.1 v2:172.21.15.119:6816/1265598191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde3800fe50 con 0x7fde28075670 2024-09-12T02:34:22.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c013240 con 0x7fdc20003a00 2024-09-12T02:34:22.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7f743d93c640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7f741c0755e0 0x7f741c077a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== osd.2 v2:172.21.15.119:6800/2688916930 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c88001d30 con 0x7f6c70075670 2024-09-12T02:34:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fdc2affd640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc340724c0 con 0x7fdc20003a00 2024-09-12T02:34:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fd459ffb640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd44806be80 0x7fd44806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd46008a3e0 con 0x7fd4640cdae0 2024-09-12T02:34:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fd459ffb640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fd448075570 0x7fd4480779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd460005ce0 con 0x7fd448075570 2024-09-12T02:34:22.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8624001030 con 0x7f862c004800 2024-09-12T02:34:22.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f863400dae0 con 0x7f862c004800 2024-09-12T02:34:22.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fd4692ee640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd44806be80 0x7fd44806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd460091050 con 0x7fd4640cdae0 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e0024070 con 0x7fa0f00720b0 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fa0e5ffb640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa0d406bf00 0x7fa0d406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa0e0093220 con 0x7fa0f00720b0 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fa0e5ffb640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fa0d4075680 0x7fa0d4077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0e0027ec0 con 0x7fa0d4075680 2024-09-12T02:34:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa0e0093610 con 0x7fa0f00720b0 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.678+0000 7f8640ff9640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f863006bf00 0x7f863006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f863408b360 con 0x7f862c004800 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8640ff9640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f8630075600 0x7f8630077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f863400ae50 con 0x7f8630075600 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8634092050 con 0x7f862c004800 2024-09-12T02:34:22.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fa0d4075680 0x7fa0d4077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7fa0f4c81640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa0d406bf00 0x7fa0d406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f86437fe640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f863006bf00 0x7f863006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8648e2a640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f8630075600 0x7f8630077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7fd4692ee640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd44806be80 0x7fd44806e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd4640b1140 tx=0x7fd45c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f8648e2a640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f8630075600 0x7f8630077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.680+0000 7f86437fe640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f863006bf00 0x7f863006e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f863803d000 tx=0x7f8638037000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.680+0000 7fa0f5c83640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fa0d4075680 0x7fa0d4077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.680+0000 7fa0f4c81640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa0d406bf00 0x7fa0d406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0208550 tx=0x7fa0e8008430 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.677+0000 7f743d93c640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7f741c0755e0 0x7f741c077a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.679+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== osd.0 v2:172.21.15.119:6808/323475018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f741c0780f0 con 0x7f741c0755e0 2024-09-12T02:34:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.680+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc1c046070 con 0x7fdc20003a00 2024-09-12T02:34:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.680+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== osd.4 v2:172.21.15.153:6800/3311949924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0e0027ec0 con 0x7fa0d4075680 2024-09-12T02:34:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.681+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== osd.6 v2:172.21.15.153:6808/3269269432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f863400ae50 con 0x7f8630075600 2024-09-12T02:34:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.681+0000 7fdc317fa640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdc1406beb0 0x7fdc1406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.681+0000 7fd469aef640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fd448075570 0x7fd4480779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.681+0000 7fdc33fff640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdc1406beb0 0x7fdc1406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdc1c076450 con 0x7fdc20003a00 2024-09-12T02:34:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc317fa640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fdc14075630 0x7fdc14077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc1c049e80 con 0x7fdc14075630 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc1c076080 con 0x7fdc20003a00 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc3977c640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fdc14075630 0x7fdc14077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fd469aef640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fd448075570 0x7fd4480779b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.682+0000 7fdc33fff640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdc1406beb0 0x7fdc1406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3415ba20 tx=0x7fdc24008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.683+0000 7fdc3977c640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fdc14075630 0x7fdc14077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.683+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== osd.7 v2:172.21.15.153:6816/3440899718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd460005ce0 con 0x7fd448075570 2024-09-12T02:34:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.687+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== osd.5 v2:172.21.15.153:6824/2972675875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc1c049e80 con 0x7fdc14075630 2024-09-12T02:34:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.701+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 --> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c6c002d50 con 0x7f6c70075670 2024-09-12T02:34:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.702+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 --> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ec8002dd0 con 0x7f1ec40755b0 2024-09-12T02:34:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.702+0000 7f6c81ffb640 1 -- 172.21.15.119:0/4158687543 <== osd.2 v2:172.21.15.119:6800/2688916930 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c6c002d50 con 0x7f6c70075670 2024-09-12T02:34:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f6c70075670 msgr2=0x7f6c70077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f6c70075670 0x7f6c70077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f1ed2ffd640 1 -- 172.21.15.119:0/1009586040 <== osd.3 v2:172.21.15.119:6824/2158673929 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ec8002dd0 con 0x7f1ec40755b0 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6c7006bf00 msgr2=0x7f6c7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6c7006bf00 0x7f6c7006e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c84033000 tx=0x7f6c84009000 comp rx=0 tx=0).stop 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 msgr2=0x7f6c8c1f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 --2- 172.21.15.119:0/4158687543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c09ca20 0x7f6c8c1f92a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800d5f0 tx=0x7f6c8800dab0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c91c7a640 1 -- 172.21.15.119:0/4158687543 reap_dead start 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 shutdown_connections 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.703+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 >> 172.21.15.119:0/4158687543 conn(0x7f6c8c0d11f0 msgr2=0x7f6c8c165330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.704+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 shutdown_connections 2024-09-12T02:34:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f6c936dd640 1 -- 172.21.15.119:0/4158687543 wait complete. 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7f1ec40755b0 msgr2=0x7f1ec40779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7f1ec40755b0 0x7f1ec40779f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1ec406be30 msgr2=0x7f1ec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1ec406be30 0x7f1ec406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40b4780 tx=0x7f1edc00d040 comp rx=0 tx=0).stop 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 msgr2=0x7f1ee41577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 --2- 172.21.15.119:0/1009586040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ee406f650 0x7f1ee41577a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400b3e0 tx=0x7f1ed400b8a0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee2d9d640 1 -- 172.21.15.119:0/1009586040 reap_dead start 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 shutdown_connections 2024-09-12T02:34:22.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.705+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 >> 172.21.15.119:0/1009586040 conn(0x7f1ee40b1e00 msgr2=0x7f1ee40b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.706+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 shutdown_connections 2024-09-12T02:34:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.706+0000 7f1ee359e640 1 -- 172.21.15.119:0/1009586040 wait complete. 2024-09-12T02:34:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.706+0000 7fde49aaf640 1 -- 172.21.15.119:0/4254469007 --> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde44073120 con 0x7fde28075670 2024-09-12T02:34:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.708+0000 7fde2ffff640 1 -- 172.21.15.119:0/4254469007 <== osd.1 v2:172.21.15.119:6816/1265598191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde44073120 con 0x7fde28075670 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.708+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde28075670 msgr2=0x7fde28077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.708+0000 7fde2dffb640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde28075670 0x7fde28077ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde2806bf00 msgr2=0x7fde2806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde2806bf00 0x7fde2806e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde3c034000 tx=0x7fde3c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 msgr2=0x7fde440caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 --2- 172.21.15.119:0/4254469007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde440d3080 0x7fde440caa50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde3800e810 tx=0x7fde3800ecd0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde43fff640 1 -- 172.21.15.119:0/4254469007 reap_dead start 2024-09-12T02:34:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 --> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f743806fb80 con 0x7f741c0755e0 2024-09-12T02:34:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 shutdown_connections 2024-09-12T02:34:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.709+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 >> 172.21.15.119:0/4254469007 conn(0x7fde4408bfc0 msgr2=0x7fde440b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.710+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 shutdown_connections 2024-09-12T02:34:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.710+0000 7fde2dffb640 1 -- 172.21.15.119:0/4254469007 wait complete. 2024-09-12T02:34:22.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.710+0000 7f742dffb640 1 -- 172.21.15.119:0/3384771493 <== osd.0 v2:172.21.15.119:6808/323475018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f743806fb80 con 0x7f741c0755e0 2024-09-12T02:34:22.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7fa0f76e6640 1 -- 172.21.15.119:0/2414517171 --> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0d0002dd0 con 0x7fa0d4075680 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7f741c0755e0 msgr2=0x7f741c077a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7f741c0755e0 0x7f741c077a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f741c06be60 msgr2=0x7f741c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f741c06be60 0x7f741c06e320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7438075790 tx=0x7f743000a040 comp rx=0 tx=0).stop 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74381559f0 msgr2=0x7f743814df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743f39f640 1 --2- 172.21.15.119:0/3384771493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74381559f0 0x7f743814df70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74340077e0 tx=0x7f7434004bb0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.711+0000 7f743d93c640 1 -- 172.21.15.119:0/3384771493 reap_dead start 2024-09-12T02:34:22.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7fa0e5ffb640 1 -- 172.21.15.119:0/2414517171 <== osd.4 v2:172.21.15.153:6800/3311949924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0d0002dd0 con 0x7fa0d4075680 2024-09-12T02:34:22.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 shutdown_connections 2024-09-12T02:34:22.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 >> 172.21.15.119:0/3384771493 conn(0x7f7438067b30 msgr2=0x7f743815e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8624002dd0 con 0x7f8630075600 2024-09-12T02:34:22.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 shutdown_connections 2024-09-12T02:34:22.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7fd46a2f0640 1 -- 172.21.15.119:0/116424623 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd444002dd0 con 0x7fd448075570 2024-09-12T02:34:22.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f743f39f640 1 -- 172.21.15.119:0/3384771493 wait complete. 2024-09-12T02:34:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fa0d4075680 msgr2=0x7fa0d4077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7fa0db7fe640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fa0d4075680 0x7fa0d4077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.712+0000 7f8640ff9640 1 -- 172.21.15.119:0/1048344453 <== osd.6 v2:172.21.15.153:6808/3269269432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8624002dd0 con 0x7f8630075600 2024-09-12T02:34:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa0d406bf00 msgr2=0x7fa0d406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fa0db7fe640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa0d406bf00 0x7fa0d406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0208550 tx=0x7fa0e8008430 comp rx=0 tx=0).stop 2024-09-12T02:34:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 msgr2=0x7fa0f00c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fa0db7fe640 1 --2- 172.21.15.119:0/2414517171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00720b0 0x7fa0f00c6d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000b450 tx=0x7fa0e000b910 comp rx=0 tx=0).stop 2024-09-12T02:34:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fa0f5c83640 1 -- 172.21.15.119:0/2414517171 reap_dead start 2024-09-12T02:34:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7fd459ffb640 1 -- 172.21.15.119:0/116424623 <== osd.7 v2:172.21.15.153:6816/3440899718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd444002dd0 con 0x7fd448075570 2024-09-12T02:34:22.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f8630075600 msgr2=0x7f8630077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f8630075600 0x7f8630077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f863006bf00 msgr2=0x7f863006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f863006bf00 0x7f863006e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f863803d000 tx=0x7f8638037000 comp rx=0 tx=0).stop 2024-09-12T02:34:22.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 msgr2=0x7f8644156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 --2- 172.21.15.119:0/1048344453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c004800 0x7f8644156990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f863400f860 tx=0x7f863400fc60 comp rx=0 tx=0).stop 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f8648e2a640 1 -- 172.21.15.119:0/1048344453 reap_dead start 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 shutdown_connections 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.713+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 >> 172.21.15.119:0/1048344453 conn(0x7f86440d23a0 msgr2=0x7f86440b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fd448075570 msgr2=0x7fd4480779b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fd448075570 0x7fd4480779b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 shutdown_connections 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 >> 172.21.15.119:0/2414517171 conn(0x7fa0f0067b30 msgr2=0x7fa0f0074760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 shutdown_connections 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fa0db7fe640 1 -- 172.21.15.119:0/2414517171 wait complete. 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 shutdown_connections 2024-09-12T02:34:22.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7f864a88d640 1 -- 172.21.15.119:0/1048344453 wait complete. 2024-09-12T02:34:22.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd44806be80 msgr2=0x7fd44806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd44806be80 0x7fd44806e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd4640b1140 tx=0x7fd45c009040 comp rx=0 tx=0).stop 2024-09-12T02:34:22.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fdc2affd640 1 -- 172.21.15.119:0/649847407 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc340724c0 con 0x7fdc14075630 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 msgr2=0x7fd46415a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd44f7fe640 1 --2- 172.21.15.119:0/116424623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4640cdae0 0x7fd46415a680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c4d0 tx=0x7fd46000c990 comp rx=0 tx=0).stop 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.714+0000 7fd469aef640 1 -- 172.21.15.119:0/116424623 reap_dead start 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.715+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 shutdown_connections 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.715+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 >> 172.21.15.119:0/116424623 conn(0x7fd4640b1e00 msgr2=0x7fd4640730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.715+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 shutdown_connections 2024-09-12T02:34:22.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.715+0000 7fd44f7fe640 1 -- 172.21.15.119:0/116424623 wait complete. 2024-09-12T02:34:22.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.715+0000 7fdc317fa640 1 -- 172.21.15.119:0/649847407 <== osd.5 v2:172.21.15.153:6824/2972675875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc340724c0 con 0x7fdc14075630 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.716+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fdc14075630 msgr2=0x7fdc14077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.716+0000 7fdc3b1df640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fdc14075630 0x7fdc14077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdc1406beb0 msgr2=0x7fdc1406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdc1406beb0 0x7fdc1406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3415ba20 tx=0x7fdc24008040 comp rx=0 tx=0).stop 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20003a00 msgr2=0x7fdc3414b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 --2- 172.21.15.119:0/649847407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc20003a00 0x7fdc3414b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c610 tx=0x7fdc1c001120 comp rx=0 tx=0).stop 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3977c640 1 -- 172.21.15.119:0/649847407 reap_dead start 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 shutdown_connections 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.717+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 >> 172.21.15.119:0/649847407 conn(0x7fdc34067b30 msgr2=0x7fdc340b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.718+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 shutdown_connections 2024-09-12T02:34:22.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.718+0000 7fdc3b1df640 1 -- 172.21.15.119:0/649847407 wait complete. 2024-09-12T02:34:22.779 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-12T02:34:22.780 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:34:22.781 INFO:teuthology.orchestra.run.smithi119.stdout:64424509448 2024-09-12T02:34:22.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:34:22.782 INFO:teuthology.orchestra.run.smithi119.stdout:64424509451 2024-09-12T02:34:22.782 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:34:22.783 INFO:teuthology.orchestra.run.smithi119.stdout:64424509449 2024-09-12T02:34:22.783 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:34:22.784 INFO:teuthology.orchestra.run.smithi119.stdout:64424509450 2024-09-12T02:34:22.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:34:22.785 INFO:teuthology.orchestra.run.smithi119.stdout:68719476747 2024-09-12T02:34:22.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:34:22.786 INFO:teuthology.orchestra.run.smithi119.stdout:68719476747 2024-09-12T02:34:22.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:34:22.787 INFO:teuthology.orchestra.run.smithi119.stdout:68719476748 2024-09-12T02:34:22.788 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:34:22.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.986+0000 7f889b5e4640 1 Processor -- start 2024-09-12T02:34:22.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.986+0000 7f889b5e4640 1 -- start start 2024-09-12T02:34:22.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.987+0000 7f514ffff640 1 Processor -- start 2024-09-12T02:34:22.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.987+0000 7f514ffff640 1 -- start start 2024-09-12T02:34:22.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f889b5e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88940727c0 0x7f88940b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f889b5e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88940b3c40 con 0x7f8894162620 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f889b5e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88940b3f20 con 0x7f8894162a00 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f889b5e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88940b3a10 con 0x7f88940727c0 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f8899380640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8894162620 0x7f88940720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49258/0 (socket says 172.21.15.119:49258) 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f8899380640 1 -- 172.21.15.119:0/3240181405 learned_addr learned my addr 172.21.15.119:0/3240181405 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f8899b81640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88940727c0 0x7f88940b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783565335 0 0) 0x7f88940b3c40 con 0x7f8894162620 2024-09-12T02:34:22.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.988+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8880003520 con 0x7f8894162620 2024-09-12T02:34:22.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514ffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51480556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f51480354c0 0x7f5148038940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514ffff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148038e80 con 0x7f51480e09c0 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514ffff640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5148039100 con 0x7f51480354c0 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514ffff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5148057400 con 0x7f5148035a80 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514effd640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f51480e09c0 0x7f5148038230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:48398/0 (socket says 172.21.15.119:48398) 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514effd640 1 -- 172.21.15.119:0/2795924343 learned_addr learned my addr 172.21.15.119:0/2795924343 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1933478871 0 0) 0x7f8880003520 con 0x7f8894162620 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88940727c0 msgr2=0x7f88940b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88940727c0 0x7f88940b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 >> v1:172.21.15.153:6789/0 conn(0x7f8894162a00 legacy=0x7f88940ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88940b4200 con 0x7f8894162620 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f8890001670 con 0x7f8894162620 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 >> v1:172.21.15.119:6789/0 conn(0x7f8894162620 legacy=0x7f88940720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88800039e0 0x7f8880003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800043d0 0x7f88800048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8880005140 0x7f888000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f888000c030 con 0x7f88800043d0 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f888000c1e0 con 0x7f8880005140 2024-09-12T02:34:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f888000c3e0 con 0x7f88800039e0 2024-09-12T02:34:22.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514e7fc640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51480556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f8899b81640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8880005140 0x7f888000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f8899380640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88800039e0 0x7f8880003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f8898b7f640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800043d0 0x7f88800048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330298362 0 0) 0x7f5150050520 con 0x7f51480e09c0 2024-09-12T02:34:22.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5138003520 con 0x7f51480e09c0 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f8899380640 1 -- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8880005140 msgr2=0x7f888000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f8899380640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8880005140 0x7f888000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f8899380640 1 -- 172.21.15.119:0/3240181405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800043d0 msgr2=0x7f88800048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f8899380640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800043d0 0x7f88800048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f8899380640 1 -- 172.21.15.119:0/3240181405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88940b4200 con 0x7f88800039e0 2024-09-12T02:34:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7fa8aa3e4640 1 Processor -- start 2024-09-12T02:34:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2276828924 0 0) 0x7f5138003520 con 0x7f51480e09c0 2024-09-12T02:34:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f04bf6dd640 1 Processor -- start 2024-09-12T02:34:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f514f7fe640 1 --2- 172.21.15.119:0/2795924343 >> v2:172.21.15.153:3300/0 conn(0x7f51480354c0 0x7f5148038940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 msgr2=0x7f51480556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f514dffb640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51480556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f4e9deb6640 1 Processor -- start 2024-09-12T02:34:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.989+0000 7f4e9deb6640 1 -- start start 2024-09-12T02:34:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 >> v2:172.21.15.153:3300/0 conn(0x7f51480354c0 msgr2=0x7f5148038940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f765b2e0640 1 Processor -- start 2024-09-12T02:34:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7fc3548f1640 1 Processor -- start 2024-09-12T02:34:23.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f04bf6dd640 1 -- start start 2024-09-12T02:34:23.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f4e9deb6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e98165f30 0x7f4e980b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f765b2e0640 1 -- start start 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f4e9deb6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e980b1830 con 0x7f4e980cf100 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f4e9deb6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e980d2470 con 0x7f4e980d1f90 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7f4e9deb6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4e980d2750 con 0x7f4e98165f30 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f4e9ceb4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e98165f30 0x7f4e980b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f4e9ceb4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e98165f30 0x7f4e980b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56930/0 (socket says 172.21.15.119:56930) 2024-09-12T02:34:23.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f4e9ceb4640 1 -- 172.21.15.119:0/148770329 learned_addr learned my addr 172.21.15.119:0/148770329 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 --2- 172.21.15.119:0/2795924343 >> v2:172.21.15.153:3300/0 conn(0x7f51480354c0 0x7f5148038940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5148054ea0 con 0x7f51480e09c0 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f515004ffb0 con 0x7f51480e09c0 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 >> v1:172.21.15.153:6789/0 conn(0x7f51480e09c0 legacy=0x7f5148038230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5138003fe0 0x7f5138004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138004d40 0x7f51380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5148039100 con 0x7f5138003fe0 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5148057400 con 0x7f5138004d40 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f513800bac0 con 0x7f5148035a80 2024-09-12T02:34:23.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514f7fe640 1 --2- 172.21.15.119:0/2795924343 >> v2:172.21.15.153:3300/0 conn(0x7f51480354c0 0x7f5148038940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:23.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7fa8aa3e4640 1 -- start start 2024-09-12T02:34:23.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f4e9ceb4640 1 -- 172.21.15.119:0/148770329 >> v1:172.21.15.153:6789/0 conn(0x7f4e980d1f90 legacy=0x7f4e980d4ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:23.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514f7fe640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138004d40 0x7f51380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8aa3e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8aa3e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a4073a00 con 0x7fa8a406ed30 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8aa3e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a40cff00 con 0x7fa8a4073450 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8aa3e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a4073ce0 con 0x7fa8a413df90 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f514effd640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7f4e977fe640 1 -- 172.21.15.119:0/148770329 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085334714 0 0) 0x7f4e90001490 con 0x7f4e980cf100 2024-09-12T02:34:23.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8a37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa8a406ed30 0x7fa8a4072d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49268/0 (socket says 172.21.15.119:49268) 2024-09-12T02:34:23.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8a37fe640 1 -- 172.21.15.119:0/1357353533 learned_addr learned my addr 172.21.15.119:0/1357353533 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:23.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.991+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1357353533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5138003fe0 0x7f5138004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bf6dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 0x7f04b80cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bf6dd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f04b80cc230 0x7f04b80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bf6dd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b80b1350 con 0x7f04b80b33f0 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bf6dd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f04b80b1630 con 0x7f04b80cc230 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bf6dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80b1910 con 0x7f04b815a690 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765b2e0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c0e2b90 0x7f764c053a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.990+0000 7fc3548f1640 1 -- start start 2024-09-12T02:34:23.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f4e9ceb4640 1 -- 172.21.15.119:0/148770329 >> v1:172.21.15.119:6789/0 conn(0x7f4e980cf100 legacy=0x7f4e980d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765b2e0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f764c006d40 0x7f764c0071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765b2e0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764c0e2f70 con 0x7f764c053f40 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765b2e0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f764c0577a0 con 0x7f764c006d40 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765b2e0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f764c057a60 con 0x7f764c0e2b90 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765aadf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f764c006d40 0x7f764c0071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765aadf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f764c006d40 0x7f764c0071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60746/0 (socket says 172.21.15.119:60746) 2024-09-12T02:34:23.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f765aadf640 1 -- 172.21.15.119:0/2890848042 learned_addr learned my addr 172.21.15.119:0/2890848042 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f4e9ceb4640 1 -- 172.21.15.119:0/148770329 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e980d2a30 con 0x7f4e98165f30 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc3548f1640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc350162ad0 0x7fc3500cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc3548f1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3500b49a0 con 0x7fc35006f6f0 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc3548f1640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3500afa20 con 0x7fc3500720b0 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc3548f1640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3500afce0 con 0x7fc350162ad0 2024-09-12T02:34:23.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc34ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc35006f6f0 0x7fc3500b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49272/0 (socket says 172.21.15.119:49272) 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fc34ed9d640 1 -- 172.21.15.119:0/3054151188 learned_addr learned my addr 172.21.15.119:0/3054151188 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34dd9b640 1 --2- 172.21.15.119:0/3054151188 >> v2:172.21.15.153:3300/0 conn(0x7fc350162ad0 0x7fc3500cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 -- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 msgr2=0x7f51380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5148035a80 0x7f51380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 -- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138004d40 msgr2=0x7f51380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138004d40 0x7f51380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f514e7fc640 1 -- 172.21.15.119:0/2795924343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5148054ea0 con 0x7f5138003fe0 2024-09-12T02:34:23.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bdc7a640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f04b80b33f0 0x7f04b815aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:48422/0 (socket says 172.21.15.119:48422) 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bdc7a640 1 -- 172.21.15.119:0/3480192611 learned_addr learned my addr 172.21.15.119:0/3480192611 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7f04bcc78640 1 --2- 172.21.15.119:0/3480192611 >> v2:172.21.15.153:3300/0 conn(0x7f04b80cc230 0x7f04b80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04bd479640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 0x7f04b80cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04affff640 1 -- 172.21.15.119:0/3480192611 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400290154 0 0) 0x7f04b80b1350 con 0x7f04b80b33f0 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f4e9ceb4640 1 --2- 172.21.15.119:0/148770329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e98165f30 0x7f4e980b12f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009870 tx=0x7f4e8802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694d96012454b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04affff640 1 -- 172.21.15.119:0/3480192611 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a4003520 con 0x7f04b80b33f0 2024-09-12T02:34:23.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702324210 0 0) 0x7fc3500b49a0 con 0x7fc35006f6f0 2024-09-12T02:34:23.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc338003520 con 0x7fc35006f6f0 2024-09-12T02:34:23.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04bcc78640 1 -- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 msgr2=0x7f04b80cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04bcc78640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 0x7f04b80cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04bcc78640 1 -- 172.21.15.119:0/3480192611 >> v1:172.21.15.153:6789/0 conn(0x7f04b80b33f0 legacy=0x7f04b815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f4e977fe640 1 -- 172.21.15.119:0/148770329 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88037070 con 0x7f4e98165f30 2024-09-12T02:34:23.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f8899380640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88800039e0 0x7f8880003e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8890001050 tx=0x7f8880005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b377e61c3bb265 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f04bcc78640 1 -- 172.21.15.119:0/3480192611 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b815bda0 con 0x7f04b80cc230 2024-09-12T02:34:23.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f4e977fe640 1 -- 172.21.15.119:0/148770329 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e88032440 con 0x7f4e98165f30 2024-09-12T02:34:23.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f765aadf640 1 -- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c0e2b90 msgr2=0x7f764c053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f765aadf640 1 --2- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c0e2b90 0x7f764c053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f765aadf640 1 -- 172.21.15.119:0/2890848042 >> v1:172.21.15.153:6789/0 conn(0x7f764c053f40 legacy=0x7f764c03be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f765aadf640 1 -- 172.21.15.119:0/2890848042 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c057d40 con 0x7f764c006d40 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2171515202 0 0) 0x7fc338003520 con 0x7fc35006f6f0 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 >> v2:172.21.15.153:3300/0 conn(0x7fc350162ad0 msgr2=0x7fc3500cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 --2- 172.21.15.119:0/3054151188 >> v2:172.21.15.153:3300/0 conn(0x7fc350162ad0 0x7fc3500cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 >> v1:172.21.15.153:6789/0 conn(0x7fc3500720b0 legacy=0x7fc350072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500b34d0 con 0x7fc35006f6f0 2024-09-12T02:34:23.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f4e977fe640 1 -- 172.21.15.119:0/148770329 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88032810 con 0x7f4e98165f30 2024-09-12T02:34:23.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fc3480019f0 con 0x7fc35006f6f0 2024-09-12T02:34:23.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 >> v1:172.21.15.119:6789/0 conn(0x7fc35006f6f0 legacy=0x7fc3500b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890007d10 con 0x7f88800039e0 2024-09-12T02:34:23.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fa8a3fff640 1 -- 172.21.15.119:0/1357353533 >> v1:172.21.15.153:6789/0 conn(0x7fa8a4073450 legacy=0x7fa8a413e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fa8a3fff640 1 -- 172.21.15.119:0/1357353533 >> v1:172.21.15.119:6789/0 conn(0x7fa8a406ed30 legacy=0x7fa8a4072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.992+0000 7fa8a3fff640 1 -- 172.21.15.119:0/1357353533 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a40d01e0 con 0x7fa8a413df90 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1357353533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40d09e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa89400bfd0 tx=0x7fa89402c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb652d92f194b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3380039d0 0x7fc338003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004800 0x7fc338004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7fc34d59a640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc33800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500afce0 con 0x7fc3380039d0 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc33800c1e0 con 0x7fc338005290 2024-09-12T02:34:23.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc33800c3e0 con 0x7fc338004800 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890005ad0 con 0x7f88800039e0 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.993+0000 7f888bfff640 1 -- 172.21.15.119:0/3240181405 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890007070 con 0x7f88800039e0 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f765aadf640 1 --2- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c0071d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f765406b010 tx=0x7f76540a6070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe75faabed8a868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f76592dc640 1 -- 172.21.15.119:0/2890848042 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540b3070 con 0x7f764c006d40 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f76592dc640 1 -- 172.21.15.119:0/2890848042 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540ae440 con 0x7f764c006d40 2024-09-12T02:34:23.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f76592dc640 1 -- 172.21.15.119:0/2890848042 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540b3070 con 0x7f764c006d40 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34e59c640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3380039d0 0x7fc338003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc33800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f514e7fc640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5138003fe0 0x7f5138004800 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f514400ba40 tx=0x7f5138005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bc2887b123c4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fa8a2ffd640 1 -- 172.21.15.119:0/1357353533 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894009540 con 0x7fa8a413df90 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fa8a2ffd640 1 -- 172.21.15.119:0/1357353533 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa894037070 con 0x7fa8a413df90 2024-09-12T02:34:23.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fa8a2ffd640 1 -- 172.21.15.119:0/1357353533 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894009940 con 0x7fa8a413df90 2024-09-12T02:34:23.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f04bd479640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 0x7f04b80cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:23.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34dd9b640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004800 0x7fc338004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 -- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004800 msgr2=0x7fc338004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004800 0x7fc338004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 -- 172.21.15.119:0/3054151188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3380039d0 msgr2=0x7fc338003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f4e9deb6640 1 -- 172.21.15.119:0/148770329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e98165f30 msgr2=0x7f4e980b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f4e9deb6640 1 --2- 172.21.15.119:0/148770329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e98165f30 0x7f4e980b12f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009870 tx=0x7f4e8802a2a0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f4e9deb6640 1 -- 172.21.15.119:0/148770329 shutdown_connections 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f4e9deb6640 1 --2- 172.21.15.119:0/148770329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e98165f30 0x7f4e980b12f0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009870 tx=0x7f4e8802a2a0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f4e9deb6640 1 -- 172.21.15.119:0/148770329 >> 172.21.15.119:0/148770329 conn(0x7f4e9808bfc0 msgr2=0x7f4e980d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f04bcc78640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b80d0460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009d90 tx=0x7f04b002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16e1011dc0d4284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144030070 con 0x7f5138003fe0 2024-09-12T02:34:23.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3380039d0 0x7fc338003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514402ade0 con 0x7f5138003fe0 2024-09-12T02:34:23.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f889b5e4640 1 -- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88800039e0 msgr2=0x7f8880003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7f889b5e4640 1 --2- 172.21.15.119:0/3240181405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88800039e0 0x7f8880003e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8890001050 tx=0x7f8880005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f514dffb640 1 -- 172.21.15.119:0/2795924343 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514400b610 con 0x7f5138003fe0 2024-09-12T02:34:23.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f8899b81640 1 -- 172.21.15.119:0/3240181405 reap_dead start 2024-09-12T02:34:23.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34ed9d640 1 -- 172.21.15.119:0/3054151188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500b34d0 con 0x7fc338005290 2024-09-12T02:34:23.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.994+0000 7fc34e59c640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3380039d0 0x7fc338003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:23.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f889b5e4640 1 -- 172.21.15.119:0/3240181405 shutdown_connections 2024-09-12T02:34:23.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f889b5e4640 1 -- 172.21.15.119:0/3240181405 >> 172.21.15.119:0/3240181405 conn(0x7f8894067d70 msgr2=0x7f889406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f04affff640 1 -- 172.21.15.119:0/3480192611 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0007740 con 0x7f04b80cc230 2024-09-12T02:34:23.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f04affff640 1 -- 172.21.15.119:0/3480192611 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b00078e0 con 0x7f04b80cc230 2024-09-12T02:34:23.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fe872fbe640 1 Processor -- start 2024-09-12T02:34:23.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f04affff640 1 -- 172.21.15.119:0/3480192611 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0007cb0 con 0x7f04b80cc230 2024-09-12T02:34:23.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/1357353533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 msgr2=0x7fa8a40d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/1357353533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40d09e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa89400bfd0 tx=0x7fa89402c910 comp rx=0 tx=0).stop 2024-09-12T02:34:23.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f4e9deb6640 1 -- 172.21.15.119:0/148770329 shutdown_connections 2024-09-12T02:34:23.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7f4e9deb6640 1 -- 172.21.15.119:0/148770329 wait complete. 2024-09-12T02:34:23.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/1357353533 shutdown_connections 2024-09-12T02:34:23.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/1357353533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40d09e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/1357353533 >> 172.21.15.119:0/1357353533 conn(0x7fa8a4067b30 msgr2=0x7fa8a406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fc34ed9d640 1 -- 172.21.15.119:0/3054151188 reap_dead start 2024-09-12T02:34:23.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/1357353533 shutdown_connections 2024-09-12T02:34:23.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.995+0000 7fe872fbe640 1 -- start start 2024-09-12T02:34:23.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/1357353533 wait complete. 2024-09-12T02:34:23.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 -- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 msgr2=0x7f764c0071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 --2- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c0071d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f765406b010 tx=0x7f76540a6070 comp rx=0 tx=0).stop 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 -- 172.21.15.119:0/2795924343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5138003fe0 msgr2=0x7f5138004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 --2- 172.21.15.119:0/2795924343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5138003fe0 0x7f5138004800 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f514400ba40 tx=0x7f5138005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514f7fe640 1 -- 172.21.15.119:0/2795924343 reap_dead start 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 -- 172.21.15.119:0/2890848042 shutdown_connections 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 --2- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c0071d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f889b5e4640 1 -- 172.21.15.119:0/3240181405 shutdown_connections 2024-09-12T02:34:23.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 --2- 172.21.15.119:0/2890848042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c0e2b90 0x7f764c053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 -- 172.21.15.119:0/2890848042 >> 172.21.15.119:0/2890848042 conn(0x7f764c03a520 msgr2=0x7f764c03a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 -- 172.21.15.119:0/2795924343 shutdown_connections 2024-09-12T02:34:23.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 -- 172.21.15.119:0/2795924343 >> 172.21.15.119:0/2795924343 conn(0x7f51480567b0 msgr2=0x7f5148056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f04bf6dd640 1 -- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 msgr2=0x7f04b80d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b80d0460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009d90 tx=0x7f04b002a660 comp rx=0 tx=0).stop 2024-09-12T02:34:23.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 -- 172.21.15.119:0/2890848042 shutdown_connections 2024-09-12T02:34:23.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 -- 172.21.15.119:0/2795924343 shutdown_connections 2024-09-12T02:34:23.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f514ffff640 1 -- 172.21.15.119:0/2795924343 wait complete. 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f889b5e4640 1 -- 172.21.15.119:0/3240181405 wait complete. 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7f765b2e0640 1 -- 172.21.15.119:0/2890848042 wait complete. 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fe872fbe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe86c0720b0 0x7fe86c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fe872fbe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe86c06f6f0 0x7fe86c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fe872fbe640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0afa20 con 0x7fe86c162ad0 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fe872fbe640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0afce0 con 0x7fe86c0720b0 2024-09-12T02:34:23.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.996+0000 7fe872fbe640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0b34d0 con 0x7fe86c06f6f0 2024-09-12T02:34:23.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7f4e9deb6640 1 Processor -- start 2024-09-12T02:34:23.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc33800b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc34800a990 tx=0x7fc338005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc814c6f47babf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7f4e9deb6640 1 -- start start 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340001350 con 0x7fc338005290 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34802f070 con 0x7fc338005290 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fa8aa3e4640 1 Processor -- start 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7f04bf6dd640 1 -- 172.21.15.119:0/3480192611 shutdown_connections 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b80d0460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/3480192611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b815a690 0x7f04b80cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f04bf6dd640 1 -- 172.21.15.119:0/3480192611 >> 172.21.15.119:0/3480192611 conn(0x7f04b80b1d40 msgr2=0x7f04b80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe86bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe86c162ad0 0x7fe86c072490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49280/0 (socket says 172.21.15.119:49280) 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe86bfff640 1 -- 172.21.15.119:0/3401633034 learned_addr learned my addr 172.21.15.119:0/3401633034 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe870d5a640 1 --2- 172.21.15.119:0/3401633034 >> v2:172.21.15.119:3300/0 conn(0x7fe86c0720b0 0x7fe86c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532344580 0 0) 0x7fe86c0afa20 con 0x7fe86c162ad0 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe854003520 con 0x7fe86c162ad0 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.997+0000 7fe87155b640 1 --2- 172.21.15.119:0/3401633034 >> v2:172.21.15.153:3300/0 conn(0x7fe86c06f6f0 0x7fe86c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898173922 0 0) 0x7fe854003520 con 0x7fe86c162ad0 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 >> v2:172.21.15.153:3300/0 conn(0x7fe86c06f6f0 msgr2=0x7fe86c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 --2- 172.21.15.119:0/3401633034 >> v2:172.21.15.153:3300/0 conn(0x7fe86c06f6f0 0x7fe86c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 >> v2:172.21.15.119:3300/0 conn(0x7fe86c0720b0 msgr2=0x7fe86c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 --2- 172.21.15.119:0/3401633034 >> v2:172.21.15.119:3300/0 conn(0x7fe86c0720b0 0x7fe86c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0b37b0 con 0x7fe86c162ad0 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fe8640019f0 con 0x7fe86c162ad0 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 >> v1:172.21.15.119:6789/0 conn(0x7fe86c162ad0 legacy=0x7fe86c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8540039b0 0x7fe854003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 0x7fe854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8540051c0 0x7fe85401c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0afce0 con 0x7fe8540051c0 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0b34d0 con 0x7fe8540039b0 2024-09-12T02:34:23.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe85401d0d0 con 0x7fe854004800 2024-09-12T02:34:23.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f765b2e0640 1 Processor -- start 2024-09-12T02:34:23.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f765b2e0640 1 -- start start 2024-09-12T02:34:23.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f889b5e4640 1 Processor -- start 2024-09-12T02:34:23.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f889b5e4640 1 -- start start 2024-09-12T02:34:23.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe870d5a640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8540039b0 0x7fe854003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc3548f1640 1 -- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 msgr2=0x7fc33800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc34d59a640 1 -- 172.21.15.119:0/3054151188 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340001350 con 0x7fc338005290 2024-09-12T02:34:23.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc3548f1640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc33800b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc34800a990 tx=0x7fc338005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f04bf6dd640 1 -- 172.21.15.119:0/3480192611 shutdown_connections 2024-09-12T02:34:23.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe86bfff640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 0x7fe854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f04bf6dd640 1 -- 172.21.15.119:0/3480192611 wait complete. 2024-09-12T02:34:23.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f4e9deb6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e980cf100 0x7f4e980cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f514ffff640 1 Processor -- start 2024-09-12T02:34:23.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f4e9deb6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc3548f1640 1 -- 172.21.15.119:0/3054151188 shutdown_connections 2024-09-12T02:34:23.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc3548f1640 1 --2- 172.21.15.119:0/3054151188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc33800b9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fc3548f1640 1 -- 172.21.15.119:0/3054151188 >> 172.21.15.119:0/3054151188 conn(0x7fc350067d70 msgr2=0x7fc35006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7f4e9deb6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e980b8010 0x7f4e980b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.998+0000 7fe87155b640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8540051c0 0x7fe85401c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fc3548f1640 1 -- 172.21.15.119:0/3054151188 shutdown_connections 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e9deb6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980cf590 con 0x7f4e980d1f90 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56986/0 (socket says 172.21.15.119:56986) 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 -- 172.21.15.119:0/3050130780 learned_addr learned my addr 172.21.15.119:0/3050130780 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e9d6b5640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e980b8010 0x7f4e980b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980d2ff0 con 0x7f4e980cf100 2024-09-12T02:34:23.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4e980cf710 con 0x7f4e980b8010 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe86bfff640 1 -- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8540039b0 msgr2=0x7fe854003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe86bfff640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8540039b0 0x7fe854003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe86bfff640 1 -- 172.21.15.119:0/3401633034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8540051c0 msgr2=0x7fe85401c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fc3548f1640 1 -- 172.21.15.119:0/3054151188 wait complete. 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 -- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e980b8010 msgr2=0x7f4e980b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e980b8010 0x7f4e980b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 -- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e980cf100 msgr2=0x7f4e980cb490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e980cf100 0x7f4e980cb490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e981f8c20 con 0x7f4e980d1f90 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88942004c0 0x7f889415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88941512d0 0x7f8894161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f765b2e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f4e97fff640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b3e0 tx=0x7f4e8c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f765b2e0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c053f40 0x7f764c17f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe86bfff640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8540051c0 0x7fe85401c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe86bfff640 1 -- 172.21.15.119:0/3401633034 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0b37b0 con 0x7fe854004800 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe87155b640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8540051c0 0x7fe85401c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7fe87155b640 1 -- 172.21.15.119:0/3401633034 reap_dead start 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88940cc640 con 0x7f88942008a0 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f8899b81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f8899b81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56992/0 (socket says 172.21.15.119:56992) 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88940cdf60 con 0x7f88942004c0 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f8899b81640 1 -- 172.21.15.119:0/871224009 learned_addr learned my addr 172.21.15.119:0/871224009 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:22.999+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88940cc7c0 con 0x7f88941512d0 2024-09-12T02:34:23.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765a2de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765a2de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60804/0 (socket says 172.21.15.119:60804) 2024-09-12T02:34:23.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c015020 con 0x7f4e980d1f90 2024-09-12T02:34:23.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765b2e0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 0x7f764c1861f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f514ffff640 1 -- start start 2024-09-12T02:34:23.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765b2e0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f764c03c550 con 0x7f764c0e2b90 2024-09-12T02:34:23.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765b2e0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f764c058300 con 0x7f764c006d40 2024-09-12T02:34:23.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765b2e0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f764c03c6d0 con 0x7f764c053f40 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765aadf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 0x7f764c1861f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765aadf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 0x7f764c1861f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57000/0 (socket says 172.21.15.119:57000) 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f765aadf640 1 -- 172.21.15.119:0/3696918212 learned_addr learned my addr 172.21.15.119:0/3696918212 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f8899380640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88942004c0 0x7f889415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c011830 con 0x7f4e980d1f90 2024-09-12T02:34:23.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e980b9810 con 0x7f4e980d1f90 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e98163030 con 0x7f4e980d1f90 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c015020 con 0x7f4e980d1f90 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7fc3548f1640 1 Processor -- start 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7fc3548f1640 1 -- start start 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 -- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88941512d0 msgr2=0x7f8894161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88941512d0 0x7f8894161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 -- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88942004c0 msgr2=0x7f889415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88942004c0 0x7f889415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f04bf6dd640 1 Processor -- start 2024-09-12T02:34:23.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894161850 con 0x7f88942008a0 2024-09-12T02:34:23.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f04bf6dd640 1 -- start start 2024-09-12T02:34:23.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.000+0000 7f7659add640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c053f40 0x7f764c17f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 -- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c053f40 msgr2=0x7f764c17f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c053f40 0x7f764c17f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 -- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 msgr2=0x7f764c1861f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 0x7f764c1861f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 -- 172.21.15.119:0/3696918212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c04cee0 con 0x7f764c006d40 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f765a2de640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f764400b440 tx=0x7f764400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f8899b81640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88940cdaa0 tx=0x7f888c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7fa8aa3e4640 1 -- start start 2024-09-12T02:34:23.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7fe86bfff640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 0x7fe854004c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe86400a8e0 tx=0x7fe854005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=246dcf66b8e0518 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644011830 con 0x7f764c006d40 2024-09-12T02:34:23.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514803c0f0 0x7f51480e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644016070 con 0x7f764c006d40 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644011c10 con 0x7f764c006d40 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f765b2e0640 1 -- 172.21.15.119:0/3696918212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c17fc90 con 0x7f764c006d40 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514804a080 0x7f514803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5148055820 con 0x7f514803c0f0 2024-09-12T02:34:23.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51480556a0 con 0x7f5138003fe0 2024-09-12T02:34:23.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.001+0000 7f514ffff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51480559a0 con 0x7f514804a080 2024-09-12T02:34:23.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f765b2e0640 1 -- 172.21.15.119:0/3696918212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c052740 con 0x7f764c006d40 2024-09-12T02:34:23.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60828/0 (socket says 172.21.15.119:60828) 2024-09-12T02:34:23.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 -- 172.21.15.119:0/1008025333 learned_addr learned my addr 172.21.15.119:0/1008025333 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc3501f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 0x7f04b8150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 -- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514804a080 msgr2=0x7f514803b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514804a080 0x7f514803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 -- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514803c0f0 msgr2=0x7f51480e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b809a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514803c0f0 0x7f51480e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 -- 172.21.15.119:0/1008025333 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480e1e30 con 0x7f5138003fe0 2024-09-12T02:34:23.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 0x7f04b80ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 0x7fc3501655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500b3d70 con 0x7fc3501603d0 2024-09-12T02:34:23.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500b3a90 con 0x7fc338005290 2024-09-12T02:34:23.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80b29e0 con 0x7f04b815a690 2024-09-12T02:34:23.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc3548f1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3500cfca0 con 0x7fc350160850 2024-09-12T02:34:23.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80b2860 con 0x7f04b80cc230 2024-09-12T02:34:23.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc34dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f514effd640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5150069310 tx=0x7f5150069640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7f04bf6dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80b2b60 con 0x7f04b80b33f0 2024-09-12T02:34:23.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.002+0000 7fc34dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57016/0 (socket says 172.21.15.119:57016) 2024-09-12T02:34:23.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fc34dd9b640 1 -- 172.21.15.119:0/326087337 learned_addr learned my addr 172.21.15.119:0/326087337 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515006d0c0 con 0x7f5138003fe0 2024-09-12T02:34:23.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515006d260 con 0x7f5138003fe0 2024-09-12T02:34:23.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86400a4e0 con 0x7fe854004800 2024-09-12T02:34:23.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86402f070 con 0x7fe854004800 2024-09-12T02:34:23.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4073450 0x7fa8a40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fe86b7fe640 1 -- 172.21.15.119:0/3401633034 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86402bdb0 con 0x7fe854004800 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a406f190 con 0x7fa8a4073450 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40d0550 con 0x7fa8a406ed30 2024-09-12T02:34:23.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8aa3e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a406f310 con 0x7fa8a413df90 2024-09-12T02:34:23.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c003da0 con 0x7f88942008a0 2024-09-12T02:34:23.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c01c070 con 0x7f88942008a0 2024-09-12T02:34:23.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c00fb70 con 0x7f88942008a0 2024-09-12T02:34:23.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 0x7fc3501655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fc34e59c640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc3501f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8a8981640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60868/0 (socket says 172.21.15.119:60868) 2024-09-12T02:34:23.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7fa8a3fff640 1 -- 172.21.15.119:0/217754282 learned_addr learned my addr 172.21.15.119:0/217754282 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515006d610 con 0x7f5138003fe0 2024-09-12T02:34:23.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8894160270 con 0x7f88942008a0 2024-09-12T02:34:23.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514803a2d0 con 0x7f5138003fe0 2024-09-12T02:34:23.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514803a890 con 0x7f5138003fe0 2024-09-12T02:34:23.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e8c018020 con 0x7f4e980d1f90 2024-09-12T02:34:23.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 -- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 msgr2=0x7fa8a40b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 -- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4073450 msgr2=0x7fa8a40b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4073450 0x7fa8a40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 -- 172.21.15.119:0/217754282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a40b0f10 con 0x7fa8a406ed30 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f04bdc7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 0x7f04b80ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f04bdc7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 0x7f04b80ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57024/0 (socket says 172.21.15.119:57024) 2024-09-12T02:34:23.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f04bdc7a640 1 -- 172.21.15.119:0/1496885674 learned_addr learned my addr 172.21.15.119:0/1496885674 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.003+0000 7f04bcc78640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b809a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f04bd479640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 0x7f04b8150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f764401b460 con 0x7f764c006d40 2024-09-12T02:34:23.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f765b2e0640 1 -- 172.21.15.119:0/3696918212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c053a00 con 0x7f764c006d40 2024-09-12T02:34:23.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d140 tx=0x7fa894004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8894160830 con 0x7f88942008a0 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fc34ed9d640 1 -- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 msgr2=0x7fc3501f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc3501f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fc34ed9d640 1 -- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 msgr2=0x7fc350165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fe872fbe640 1 -- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 msgr2=0x7fe854004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fe872fbe640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 0x7fe854004c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe86400a8e0 tx=0x7fe854005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fe872fbe640 1 -- 172.21.15.119:0/3401633034 shutdown_connections 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fe872fbe640 1 --2- 172.21.15.119:0/3401633034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe854004800 0x7fe854004c80 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe86400a8e0 tx=0x7fe854005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fe872fbe640 1 -- 172.21.15.119:0/3401633034 >> 172.21.15.119:0/3401633034 conn(0x7fe86c067d70 msgr2=0x7fe86c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 -- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 msgr2=0x7f04b809a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b809a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 -- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 msgr2=0x7f04b80ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 0x7f04b80ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f764affd640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 0x7f763806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f7659add640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 0x7f763806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 -- 172.21.15.119:0/1496885674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80cd830 con 0x7f04b80b33f0 2024-09-12T02:34:23.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bcc78640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b809a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04bd479640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 0x7f04b8150990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e900 tx=0x7f04b400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7fc34ed9d640 1 -- 172.21.15.119:0/326087337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3501f9090 con 0x7fc350160850 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fc34dd9b640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fc34ed9d640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 0x7fc3501655c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ccfb0 tx=0x7fc34802d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34800a560 con 0x7fc350160850 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc348001b00 con 0x7fc350160850 2024-09-12T02:34:23.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148038230 con 0x7f5138003fe0 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.004+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e980b12f0 con 0x7f4e980d1f90 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894032890 con 0x7fa8a406ed30 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa894032a30 con 0x7fa8a406ed30 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894032e20 con 0x7fa8a406ed30 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a40b11f0 con 0x7fa8a406ed30 2024-09-12T02:34:23.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7fe872fbe640 1 -- 172.21.15.119:0/3401633034 shutdown_connections 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a40b17b0 con 0x7fa8a406ed30 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4017070 con 0x7f04b80b33f0 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b400ca00 con 0x7f04b80b33f0 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.005+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b400cdf0 con 0x7f04b80b33f0 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b8156380 con 0x7f04b80b33f0 2024-09-12T02:34:23.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b809a6e0 con 0x7f04b80b33f0 2024-09-12T02:34:23.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34802bba0 con 0x7fc350160850 2024-09-12T02:34:23.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f515009d350 con 0x7f5138003fe0 2024-09-12T02:34:23.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f5137fff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 0x7f513c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7f4e957fa640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 0x7f4e8406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4e8c08acf0 con 0x7f4e980d1f90 2024-09-12T02:34:23.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3500a97c0 con 0x7fc350160850 2024-09-12T02:34:23.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501f87f0 con 0x7fc350160850 2024-09-12T02:34:23.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5150106db0 con 0x7f5138003fe0 2024-09-12T02:34:23.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f764408ac70 con 0x7f764c006d40 2024-09-12T02:34:23.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f888c00fd10 con 0x7f88942008a0 2024-09-12T02:34:23.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f4e9ceb4640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 0x7f4e8406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88940b34d0 con 0x7f88942008a0 2024-09-12T02:34:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7f514e7fc640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 0x7f513c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b81586a0 con 0x7f04b80b33f0 2024-09-12T02:34:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.006+0000 7fe872fbe640 1 -- 172.21.15.119:0/3401633034 wait complete. 2024-09-12T02:34:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.007+0000 7fe872fbe640 1 Processor -- start 2024-09-12T02:34:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7fe872fbe640 1 -- start start 2024-09-12T02:34:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7f7659add640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 0x7f763806e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f764c0374f0 tx=0x7f7650009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a4069730 con 0x7fa8a406ed30 2024-09-12T02:34:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7f514e7fc640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 0x7f513c06e3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f514400ba10 tx=0x7f514402c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.008+0000 7f4e9ceb4640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 0x7f4e8406e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e88034000 tx=0x7f4e8802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04b401a070 con 0x7f04b80b33f0 2024-09-12T02:34:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc350072490 con 0x7fc350160850 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f8889ffb640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 0x7f887806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f8899380640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 0x7f887806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f888c08b890 con 0x7f88942008a0 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe86c151490 0x7fe86c08b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 0x7fe86c08b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 0x7fe86c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0cfca0 con 0x7fe86c155190 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0b3d70 con 0x7fe86c151870 2024-09-12T02:34:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe872fbe640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c0cfe20 con 0x7fe86c151490 2024-09-12T02:34:23.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f04adffb640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 0x7f049c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f04bcc78640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 0x7f049c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc348034470 con 0x7fc350160850 2024-09-12T02:34:23.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7f8899380640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 0x7f887806e3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8890032000 tx=0x7f8890009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 0x7fe86c08b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 0x7fe86c08b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:60874/0 (socket says 172.21.15.119:60874) 2024-09-12T02:34:23.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.009+0000 7fe86bfff640 1 -- 172.21.15.119:0/1041067515 learned_addr learned my addr 172.21.15.119:0/1041067515 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe870d5a640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe86c151490 0x7fe86c08b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 0x7fe86c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f04b40573a0 con 0x7f04b80b33f0 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7f04bcc78640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 0x7f049c06e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04b0034000 tx=0x7f04b002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 -- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe86c151490 msgr2=0x7fe86c08b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe86c151490 0x7fe86c08b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 -- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 msgr2=0x7fe86c08b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 0x7fe86c08b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 -- 172.21.15.119:0/1041067515 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c1543d0 con 0x7fe86c155190 2024-09-12T02:34:23.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fc33effd640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 0x7fc33006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fe87155b640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 0x7fe86c155610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe86c070250 tx=0x7fe860004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fc34e59c640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 0x7fc33006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.010+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc3480aadd0 con 0x7fc350160850 2024-09-12T02:34:23.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.011+0000 7fc34e59c640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 0x7fc33006e370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3500cc800 tx=0x7fc340009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.011+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7644059350 con 0x7f764c006d40 2024-09-12T02:34:23.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.012+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa894043020 con 0x7fa8a406ed30 2024-09-12T02:34:23.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.013+0000 7fa8a0ff9640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 0x7fa88406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.013+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e8c0bcd50 con 0x7f4e980d1f90 2024-09-12T02:34:23.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.014+0000 7fa8a37fe640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 0x7fa88406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.014+0000 7fa8a37fe640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 0x7fa88406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a406d8d0 tx=0x7fa88c007a40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.015+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3480794a0 con 0x7fc350160850 2024-09-12T02:34:23.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.016+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa89403cde0 con 0x7fa8a406ed30 2024-09-12T02:34:23.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.016+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5148038e80 con 0x7f5138003fe0 2024-09-12T02:34:23.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.018+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f888c010040 con 0x7f88942008a0 2024-09-12T02:34:23.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.018+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860014660 con 0x7fe86c155190 2024-09-12T02:34:23.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.018+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c1546b0 con 0x7fe86c155190 2024-09-12T02:34:23.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.018+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c154c70 con 0x7fe86c155190 2024-09-12T02:34:23.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.020+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04b4059300 con 0x7f04b80b33f0 2024-09-12T02:34:23.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.019+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86001a070 con 0x7fe86c155190 2024-09-12T02:34:23.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.020+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c154e70 con 0x7fe86c155190 2024-09-12T02:34:23.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.021+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860014660 con 0x7fe86c155190 2024-09-12T02:34:23.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.021+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa89407a8d0 con 0x7fa8a406ed30 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.032+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe860012070 con 0x7fe86c155190 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.032+0000 7fe8697fa640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 0x7fe85806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.033+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe860014460 con 0x7fe86c155190 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.033+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe86c154e70 con 0x7fe86c155190 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.034+0000 7fe870d5a640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 0x7fe85806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.034+0000 7fe870d5a640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 0x7fe85806e6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe86c06ab20 tx=0x7fe85c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.404+0000 7f765b2e0640 1 -- 172.21.15.119:0/3696918212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f764c0e5950 con 0x7f764c006d40 2024-09-12T02:34:23.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.405+0000 7f764affd640 1 -- 172.21.15.119:0/3696918212 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7644058c50 con 0x7f764c006d40 2024-09-12T02:34:23.406 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-12T02:34:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.408+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc3500b1bd0 con 0x7fc350160850 2024-09-12T02:34:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.408+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 msgr2=0x7f763806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.408+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 0x7f763806e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f764c0374f0 tx=0x7f7650009040 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 msgr2=0x7f764c04c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f764400b440 tx=0x7f764400b900 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 shutdown_connections 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f763806bf00 0x7f763806e3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764c0e2b90 0x7f764c1861f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764c053f40 0x7f764c17f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 --2- 172.21.15.119:0/3696918212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764c006d40 0x7f764c04c9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 >> 172.21.15.119:0/3696918212 conn(0x7f764c03a520 msgr2=0x7f764c03cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 shutdown_connections 2024-09-12T02:34:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.409+0000 7f7648ff9640 1 -- 172.21.15.119:0/3696918212 wait complete. 2024-09-12T02:34:23.413 INFO:teuthology.orchestra.run.smithi119.stdout:64424509451 2024-09-12T02:34:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.411+0000 7fc33effd640 1 -- 172.21.15.119:0/326087337 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc348078da0 con 0x7fc350160850 2024-09-12T02:34:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.412+0000 7f4e9deb6640 1 -- 172.21.15.119:0/3050130780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e980b6470 con 0x7f4e980d1f90 2024-09-12T02:34:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.413+0000 7f4e957fa640 1 -- 172.21.15.119:0/3050130780 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e8c01f020 con 0x7f4e980d1f90 2024-09-12T02:34:23.414 INFO:teuthology.orchestra.run.smithi119.stdout:64424509450 2024-09-12T02:34:23.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.414+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 msgr2=0x7fc33006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.414+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 0x7fc33006e370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3500cc800 tx=0x7fc340009040 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.414+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 msgr2=0x7fc3501655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.414+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 0x7fc3501655c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ccfb0 tx=0x7fc34802d070 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.414+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 shutdown_connections 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc33006beb0 0x7fc33006e370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc350160850 0x7fc3501655c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3501603d0 0x7fc350165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 --2- 172.21.15.119:0/326087337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc338005290 0x7fc3501f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 >> 172.21.15.119:0/326087337 conn(0x7fc350067d70 msgr2=0x7fc35006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 shutdown_connections 2024-09-12T02:34:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.415+0000 7fc3548f1640 1 -- 172.21.15.119:0/326087337 wait complete. 2024-09-12T02:34:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 msgr2=0x7f4e8406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 0x7f4e8406e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e88034000 tx=0x7f4e8802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 msgr2=0x7f4e980cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b3e0 tx=0x7f4e8c00b8a0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f88940afb70 con 0x7f88942008a0 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 shutdown_connections 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4e8406c030 0x7f4e8406e4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e980b8010 0x7f4e980b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e980d1f90 0x7f4e980cb9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 --2- 172.21.15.119:0/3050130780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e980cf100 0x7f4e980cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.418+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 >> 172.21.15.119:0/3050130780 conn(0x7f4e9808bfc0 msgr2=0x7f4e980b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.419+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 shutdown_connections 2024-09-12T02:34:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.419+0000 7f8889ffb640 1 -- 172.21.15.119:0/871224009 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f888c059f70 con 0x7f88942008a0 2024-09-12T02:34:23.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.419+0000 7f4e7f7fe640 1 -- 172.21.15.119:0/3050130780 wait complete. 2024-09-12T02:34:23.421 INFO:teuthology.orchestra.run.smithi119.stdout:64424509448 2024-09-12T02:34:23.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.422+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 msgr2=0x7f887806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.422+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 0x7f887806e3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8890032000 tx=0x7f8890009030 comp rx=0 tx=0).stop 2024-09-12T02:34:23.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.422+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 msgr2=0x7f88941517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.422+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88940cdaa0 tx=0x7f888c00f1b0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.422+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5148053c20 con 0x7f5138003fe0 2024-09-12T02:34:23.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.423+0000 7f5137fff640 1 -- 172.21.15.119:0/1008025333 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51500d5400 con 0x7f5138003fe0 2024-09-12T02:34:23.424 INFO:teuthology.orchestra.run.smithi119.stdout:64424509449 2024-09-12T02:34:23.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 shutdown_connections 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f887806bf30 0x7f887806e3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88942008a0 0x7f88941517b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88941512d0 0x7f8894161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 --2- 172.21.15.119:0/871224009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88942004c0 0x7f889415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 >> 172.21.15.119:0/871224009 conn(0x7f8894067d70 msgr2=0x7f88940b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 shutdown_connections 2024-09-12T02:34:23.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.424+0000 7f889b5e4640 1 -- 172.21.15.119:0/871224009 wait complete. 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.426+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 msgr2=0x7f513c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.426+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 0x7f513c06e3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f514400ba10 tx=0x7f514402c000 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 msgr2=0x7f51480d8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5150069310 tx=0x7f5150069640 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 shutdown_connections 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f513c06bf30 0x7f513c06e3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514804a080 0x7f514803b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514803c0f0 0x7f51480e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 --2- 172.21.15.119:0/1008025333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5138003fe0 0x7f51480d8be0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 >> 172.21.15.119:0/1008025333 conn(0x7f51480567b0 msgr2=0x7f5148037580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.427+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe86c0afa20 con 0x7fe86c155190 2024-09-12T02:34:23.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.428+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 shutdown_connections 2024-09-12T02:34:23.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.428+0000 7f514ffff640 1 -- 172.21.15.119:0/1008025333 wait complete. 2024-09-12T02:34:23.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.428+0000 7fe8697fa640 1 -- 172.21.15.119:0/1041067515 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe86c154e70 con 0x7fe86c155190 2024-09-12T02:34:23.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.428+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f04b806cc20 con 0x7f04b80b33f0 2024-09-12T02:34:23.430 INFO:teuthology.orchestra.run.smithi119.stdout:68719476748 2024-09-12T02:34:23.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-09-12T02:34:23.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.429+0000 7f04adffb640 1 -- 172.21.15.119:0/1496885674 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04b405d600 con 0x7f04b80b33f0 2024-09-12T02:34:23.431 INFO:teuthology.orchestra.run.smithi119.stdout:68719476747 2024-09-12T02:34:23.431 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.431+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa8a40ce820 con 0x7fa8a406ed30 2024-09-12T02:34:23.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 msgr2=0x7fe85806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 0x7fe85806e6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe86c06ab20 tx=0x7fe85c008040 comp rx=0 tx=0).stop 2024-09-12T02:34:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 msgr2=0x7fe86c155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 0x7fe86c155610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe86c070250 tx=0x7fe860004610 comp rx=0 tx=0).stop 2024-09-12T02:34:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fa8a0ff9640 1 -- 172.21.15.119:0/217754282 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa89407ebd0 con 0x7fa8a406ed30 2024-09-12T02:34:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 shutdown_connections 2024-09-12T02:34:23.433 INFO:teuthology.orchestra.run.smithi119.stdout:68719476747 2024-09-12T02:34:23.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fe85806c230 0x7fe85806e6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c155190 0x7fe86c155610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86c151870 0x7fe86c08b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 --2- 172.21.15.119:0/1041067515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe86c151490 0x7fe86c08b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 >> 172.21.15.119:0/1041067515 conn(0x7fe86c067d70 msgr2=0x7fe86c0b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.432+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 shutdown_connections 2024-09-12T02:34:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7fe872fbe640 1 -- 172.21.15.119:0/1041067515 wait complete. 2024-09-12T02:34:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 msgr2=0x7f049c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 0x7f049c06e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04b0034000 tx=0x7f04b002f000 comp rx=0 tx=0).stop 2024-09-12T02:34:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 msgr2=0x7f04b8150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 0x7f04b8150990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e900 tx=0x7f04b400edc0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 shutdown_connections 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f049c06be80 0x7f049c06e340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04b815a690 0x7f04b80ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b80cc230 0x7f04b809a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 --2- 172.21.15.119:0/1496885674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04b80b33f0 0x7f04b8150990 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e900 tx=0x7f04b400edc0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 >> 172.21.15.119:0/1496885674 conn(0x7f04b80b1d40 msgr2=0x7f04b80b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.433+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 shutdown_connections 2024-09-12T02:34:23.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.434+0000 7f04bf6dd640 1 -- 172.21.15.119:0/1496885674 wait complete. 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 msgr2=0x7fa88406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 0x7fa88406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a406d8d0 tx=0x7fa88c007a40 comp rx=0 tx=0).stop 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 msgr2=0x7fa8a40b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d140 tx=0x7fa894004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 shutdown_connections 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa88406be30 0x7fa88406e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a413df90 0x7fa8a40b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4073450 0x7fa8a40b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 --2- 172.21.15.119:0/217754282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a406ed30 0x7fa8a40b0930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 >> 172.21.15.119:0/217754282 conn(0x7fa8a4067b30 msgr2=0x7fa8a413e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 shutdown_connections 2024-09-12T02:34:23.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.436+0000 7fa8aa3e4640 1 -- 172.21.15.119:0/217754282 wait complete. 2024-09-12T02:34:23.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-09-12T02:34:23.442 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-12T02:34:23.442 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-12T02:34:23.445 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.7 2024-09-12T02:34:23.450 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-12T02:34:23.450 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.4 2024-09-12T02:34:23.453 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.5 2024-09-12T02:34:23.453 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:23.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:34:23.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:23.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.592+0000 7f5c9723c640 1 Processor -- start 2024-09-12T02:34:23.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.592+0000 7f5c9723c640 1 -- start start 2024-09-12T02:34:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c9723c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c9006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c9723c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c900d2700 con 0x7f5c9015e760 2024-09-12T02:34:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c9723c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c900cedb0 con 0x7f5c900d4fd0 2024-09-12T02:34:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c9723c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c900cf090 con 0x7f5c900cfcc0 2024-09-12T02:34:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c94fd8640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5c9015e760 0x7f5c900cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49286/0 (socket says 172.21.15.119:49286) 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c94fd8640 1 -- 172.21.15.119:0/935254472 learned_addr learned my addr 172.21.15.119:0/935254472 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8ffff640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c9006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181973215 0 0) 0x7f5c84001110 con 0x7f5c9015e760 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c80003520 con 0x7f5c9015e760 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4139895414 0 0) 0x7f5c80003520 con 0x7f5c9015e760 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 msgr2=0x7f5c9006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c9006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 >> v1:172.21.15.153:6789/0 conn(0x7f5c900d4fd0 legacy=0x7f5c900d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c900b3c80 con 0x7f5c9015e760 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f5c84001840 con 0x7f5c9015e760 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 >> v1:172.21.15.119:6789/0 conn(0x7f5c9015e760 legacy=0x7f5c900cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c80004390 0x7f5c80004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c800050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.593+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900cf090 con 0x7f5c800039e0 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8000b9f0 con 0x7f5c80004390 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8000bbf0 con 0x7f5c900cfcc0 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c957d9640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c800050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c8ffff640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c80004390 0x7f5c80004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 -- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 msgr2=0x7f5c800050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c800050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 -- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c80004390 msgr2=0x7f5c80004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c80004390 0x7f5c80004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c94fd8640 1 -- 172.21.15.119:0/935254472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c80003520 con 0x7f5c800039e0 2024-09-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.594+0000 7f5c957d9640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cfcc0 0x7f5c800050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c80003dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c4c0 tx=0x7f5c80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b68459ca7f1aad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400c0e0 con 0x7f5c800039e0 2024-09-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c84034070 con 0x7f5c800039e0 2024-09-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c8f7fe640 1 -- 172.21.15.119:0/935254472 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84005d30 con 0x7f5c800039e0 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 -- 172.21.15.119:0/935254472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 msgr2=0x7f5c80003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 --2- 172.21.15.119:0/935254472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c80003dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c4c0 tx=0x7f5c80005830 comp rx=0 tx=0).stop 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c957d9640 1 -- 172.21.15.119:0/935254472 reap_dead start 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 -- 172.21.15.119:0/935254472 shutdown_connections 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 -- 172.21.15.119:0/935254472 >> 172.21.15.119:0/935254472 conn(0x7f5c9008bfc0 msgr2=0x7f5c900d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 -- 172.21.15.119:0/935254472 shutdown_connections 2024-09-12T02:34:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.595+0000 7f5c9723c640 1 -- 172.21.15.119:0/935254472 wait complete. 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 Processor -- start 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 -- start start 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cdf50 0x7f5c900c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c900ca3d0 0x7f5c900ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9006cdd0 con 0x7f5c800039e0 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900b3860 con 0x7f5c900ca3d0 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c9723c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9006cf50 con 0x7f5c900cdf50 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.597+0000 7f5c94fd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57062/0 (socket says 172.21.15.119:57062) 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 -- 172.21.15.119:0/3923531004 learned_addr learned my addr 172.21.15.119:0/3923531004 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c8ffff640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cdf50 0x7f5c900c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 -- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cdf50 msgr2=0x7f5c900c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c957d9640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c900ca3d0 0x7f5c900ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cdf50 0x7f5c900c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 -- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c900ca3d0 msgr2=0x7f5c900ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c900ca3d0 0x7f5c900ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 -- 172.21.15.119:0/3923531004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c900c9500 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c94fd8640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5c84001ac0 tx=0x7f5c84001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84007070 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c84007210 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c900c97e0 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c840075c0 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.598+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c900c9da0 con 0x7f5c800039e0 2024-09-12T02:34:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.599+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c900b6d20 con 0x7f5c800039e0 2024-09-12T02:34:23.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.600+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c8402e070 con 0x7f5c800039e0 2024-09-12T02:34:23.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.600+0000 7f5c8d7fa640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 0x7f5c7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.600+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5c840abc70 con 0x7f5c800039e0 2024-09-12T02:34:23.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.600+0000 7f5c8ffff640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 0x7f5c7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.601+0000 7f5c8ffff640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 0x7f5c7406e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c900ce6d0 tx=0x7f5c7c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.604+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c8402c040 con 0x7f5c800039e0 2024-09-12T02:34:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.767+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c900b73e0 con 0x7f5c7406be60 2024-09-12T02:34:23.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.775+0000 7f5c8d7fa640 1 -- 172.21.15.119:0/3923531004 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5c900b73e0 con 0x7f5c7406be60 2024-09-12T02:34:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:23.784 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:23.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 msgr2=0x7f5c7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 0x7f5c7406e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c900ce6d0 tx=0x7f5c7c008040 comp rx=0 tx=0).stop 2024-09-12T02:34:23.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 msgr2=0x7f5c9015c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5c84001ac0 tx=0x7f5c84001b90 comp rx=0 tx=0).stop 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 shutdown_connections 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5c7406be60 0x7f5c7406e320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c900ca3d0 0x7f5c900ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c900cdf50 0x7f5c900c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 --2- 172.21.15.119:0/3923531004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c800039e0 0x7f5c9015c3d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 >> 172.21.15.119:0/3923531004 conn(0x7f5c9008bfc0 msgr2=0x7f5c900b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 shutdown_connections 2024-09-12T02:34:23.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.778+0000 7f5c9723c640 1 -- 172.21.15.119:0/3923531004 wait complete. 2024-09-12T02:34:23.790 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-12T02:34:23.183552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219636,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755084,"statfs":{"total":773094113280,"available":772869206016,"internally_reserved":0,"allocated":3481600,"data_stored":2094460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003544"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347397+0000","last_change":"2024-09-12T02:34:00.057067+0000","last_active":"2024-09-12T02:34:07.347397+0000","last_peered":"2024-09-12T02:34:07.347397+0000","last_clean":"2024-09-12T02:34:07.347397+0000","last_became_active":"2024-09-12T02:34:00.056766+0000","last_became_peered":"2024-09-12T02:34:00.056766+0000","last_unstale":"2024-09-12T02:34:07.347397+0000","last_undegraded":"2024-09-12T02:34:07.347397+0000","last_fullsized":"2024-09-12T02:34:07.347397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:36.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562594+0000","last_change":"2024-09-12T02:34:01.061517+0000","last_active":"2024-09-12T02:34:08.562594+0000","last_peered":"2024-09-12T02:34:08.562594+0000","last_clean":"2024-09-12T02:34:08.562594+0000","last_became_active":"2024-09-12T02:34:01.061120+0000","last_became_peered":"2024-09-12T02:34:01.061120+0000","last_unstale":"2024-09-12T02:34:08.562594+0000","last_undegraded":"2024-09-12T02:34:08.562594+0000","last_fullsized":"2024-09-12T02:34:08.562594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:18.386298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562151+0000","last_change":"2024-09-12T02:34:05.658529+0000","last_active":"2024-09-12T02:34:08.562151+0000","last_peered":"2024-09-12T02:34:08.562151+0000","last_clean":"2024-09-12T02:34:08.562151+0000","last_became_active":"2024-09-12T02:34:05.658141+0000","last_became_peered":"2024-09-12T02:34:05.658141+0000","last_unstale":"2024-09-12T02:34:08.562151+0000","last_undegraded":"2024-09-12T02:34:08.562151+0000","last_fullsized":"2024-09-12T02:34:08.562151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:35.123440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561735+0000","last_change":"2024-09-12T02:34:00.059738+0000","last_active":"2024-09-12T02:34:08.561735+0000","last_peered":"2024-09-12T02:34:08.561735+0000","last_clean":"2024-09-12T02:34:08.561735+0000","last_became_active":"2024-09-12T02:34:00.059507+0000","last_became_peered":"2024-09-12T02:34:00.059507+0000","last_unstale":"2024-09-12T02:34:08.561735+0000","last_undegraded":"2024-09-12T02:34:08.561735+0000","last_fullsized":"2024-09-12T02:34:08.561735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347277+0000","last_change":"2024-09-12T02:34:01.066517+0000","last_active":"2024-09-12T02:34:07.347277+0000","last_peered":"2024-09-12T02:34:07.347277+0000","last_clean":"2024-09-12T02:34:07.347277+0000","last_became_active":"2024-09-12T02:34:01.066244+0000","last_became_peered":"2024-09-12T02:34:01.066244+0000","last_unstale":"2024-09-12T02:34:07.347277+0000","last_undegraded":"2024-09-12T02:34:07.347277+0000","last_fullsized":"2024-09-12T02:34:07.347277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094181+0000","last_change":"2024-09-12T02:34:05.080417+0000","last_active":"2024-09-12T02:34:07.094181+0000","last_peered":"2024-09-12T02:34:07.094181+0000","last_clean":"2024-09-12T02:34:07.094181+0000","last_became_active":"2024-09-12T02:34:05.079990+0000","last_became_peered":"2024-09-12T02:34:05.079990+0000","last_unstale":"2024-09-12T02:34:07.094181+0000","last_undegraded":"2024-09-12T02:34:07.094181+0000","last_fullsized":"2024-09-12T02:34:07.094181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:13.003179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835917+0000","last_change":"2024-09-12T02:34:00.065442+0000","last_active":"2024-09-12T02:34:08.835917+0000","last_peered":"2024-09-12T02:34:08.835917+0000","last_clean":"2024-09-12T02:34:08.835917+0000","last_became_active":"2024-09-12T02:34:00.065146+0000","last_became_peered":"2024-09-12T02:34:00.065146+0000","last_unstale":"2024-09-12T02:34:08.835917+0000","last_undegraded":"2024-09-12T02:34:08.835917+0000","last_fullsized":"2024-09-12T02:34:08.835917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:05.525436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895899+0000","last_change":"2024-09-12T02:34:01.063766+0000","last_active":"2024-09-12T02:34:07.895899+0000","last_peered":"2024-09-12T02:34:07.895899+0000","last_clean":"2024-09-12T02:34:07.895899+0000","last_became_active":"2024-09-12T02:34:01.063502+0000","last_became_peered":"2024-09-12T02:34:01.063502+0000","last_unstale":"2024-09-12T02:34:07.895899+0000","last_undegraded":"2024-09-12T02:34:07.895899+0000","last_fullsized":"2024-09-12T02:34:07.895899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093971+0000","last_change":"2024-09-12T02:34:05.079431+0000","last_active":"2024-09-12T02:34:07.093971+0000","last_peered":"2024-09-12T02:34:07.093971+0000","last_clean":"2024-09-12T02:34:07.093971+0000","last_became_active":"2024-09-12T02:34:05.079067+0000","last_became_peered":"2024-09-12T02:34:05.079067+0000","last_unstale":"2024-09-12T02:34:07.093971+0000","last_undegraded":"2024-09-12T02:34:07.093971+0000","last_fullsized":"2024-09-12T02:34:07.093971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835848+0000","last_change":"2024-09-12T02:34:00.061054+0000","last_active":"2024-09-12T02:34:08.835848+0000","last_peered":"2024-09-12T02:34:08.835848+0000","last_clean":"2024-09-12T02:34:08.835848+0000","last_became_active":"2024-09-12T02:34:00.060797+0000","last_became_peered":"2024-09-12T02:34:00.060797+0000","last_unstale":"2024-09-12T02:34:08.835848+0000","last_undegraded":"2024-09-12T02:34:08.835848+0000","last_fullsized":"2024-09-12T02:34:08.835848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896093+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:07.896093+0000","last_peered":"2024-09-12T02:34:07.896093+0000","last_clean":"2024-09-12T02:34:07.896093+0000","last_became_active":"2024-09-12T02:34:01.067112+0000","last_became_peered":"2024-09-12T02:34:01.067112+0000","last_unstale":"2024-09-12T02:34:07.896093+0000","last_undegraded":"2024-09-12T02:34:07.896093+0000","last_fullsized":"2024-09-12T02:34:07.896093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093944+0000","last_change":"2024-09-12T02:34:05.077446+0000","last_active":"2024-09-12T02:34:07.093944+0000","last_peered":"2024-09-12T02:34:07.093944+0000","last_clean":"2024-09-12T02:34:07.093944+0000","last_became_active":"2024-09-12T02:34:05.077106+0000","last_became_peered":"2024-09-12T02:34:05.077106+0000","last_unstale":"2024-09-12T02:34:07.093944+0000","last_undegraded":"2024-09-12T02:34:07.093944+0000","last_fullsized":"2024-09-12T02:34:07.093944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094605+0000","last_change":"2024-09-12T02:34:01.056215+0000","last_active":"2024-09-12T02:34:07.094605+0000","last_peered":"2024-09-12T02:34:07.094605+0000","last_clean":"2024-09-12T02:34:07.094605+0000","last_became_active":"2024-09-12T02:34:01.055913+0000","last_became_peered":"2024-09-12T02:34:01.055913+0000","last_unstale":"2024-09-12T02:34:07.094605+0000","last_undegraded":"2024-09-12T02:34:07.094605+0000","last_fullsized":"2024-09-12T02:34:07.094605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835838+0000","last_change":"2024-09-12T02:34:00.058795+0000","last_active":"2024-09-12T02:34:08.835838+0000","last_peered":"2024-09-12T02:34:08.835838+0000","last_clean":"2024-09-12T02:34:08.835838+0000","last_became_active":"2024-09-12T02:34:00.058542+0000","last_became_peered":"2024-09-12T02:34:00.058542+0000","last_unstale":"2024-09-12T02:34:08.835838+0000","last_undegraded":"2024-09-12T02:34:08.835838+0000","last_fullsized":"2024-09-12T02:34:08.835838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095266+0000","last_change":"2024-09-12T02:34:05.081285+0000","last_active":"2024-09-12T02:34:07.095266+0000","last_peered":"2024-09-12T02:34:07.095266+0000","last_clean":"2024-09-12T02:34:07.095266+0000","last_became_active":"2024-09-12T02:34:05.080737+0000","last_became_peered":"2024-09-12T02:34:05.080737+0000","last_unstale":"2024-09-12T02:34:07.095266+0000","last_undegraded":"2024-09-12T02:34:07.095266+0000","last_fullsized":"2024-09-12T02:34:07.095266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562380+0000","last_change":"2024-09-12T02:34:01.058977+0000","last_active":"2024-09-12T02:34:08.562380+0000","last_peered":"2024-09-12T02:34:08.562380+0000","last_clean":"2024-09-12T02:34:08.562380+0000","last_became_active":"2024-09-12T02:34:01.058631+0000","last_became_peered":"2024-09-12T02:34:01.058631+0000","last_unstale":"2024-09-12T02:34:08.562380+0000","last_undegraded":"2024-09-12T02:34:08.562380+0000","last_fullsized":"2024-09-12T02:34:08.562380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:31.239556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265847+0000","last_change":"2024-09-12T02:34:00.058689+0000","last_active":"2024-09-12T02:34:07.265847+0000","last_peered":"2024-09-12T02:34:07.265847+0000","last_clean":"2024-09-12T02:34:07.265847+0000","last_became_active":"2024-09-12T02:34:00.058428+0000","last_became_peered":"2024-09-12T02:34:00.058428+0000","last_unstale":"2024-09-12T02:34:07.265847+0000","last_undegraded":"2024-09-12T02:34:07.265847+0000","last_fullsized":"2024-09-12T02:34:07.265847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095071+0000","last_change":"2024-09-12T02:34:05.080503+0000","last_active":"2024-09-12T02:34:07.095071+0000","last_peered":"2024-09-12T02:34:07.095071+0000","last_clean":"2024-09-12T02:34:07.095071+0000","last_became_active":"2024-09-12T02:34:05.080079+0000","last_became_peered":"2024-09-12T02:34:05.080079+0000","last_unstale":"2024-09-12T02:34:07.095071+0000","last_undegraded":"2024-09-12T02:34:07.095071+0000","last_fullsized":"2024-09-12T02:34:07.095071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562242+0000","last_change":"2024-09-12T02:34:01.050151+0000","last_active":"2024-09-12T02:34:08.562242+0000","last_peered":"2024-09-12T02:34:08.562242+0000","last_clean":"2024-09-12T02:34:08.562242+0000","last_became_active":"2024-09-12T02:34:01.049816+0000","last_became_peered":"2024-09-12T02:34:01.049816+0000","last_unstale":"2024-09-12T02:34:08.562242+0000","last_undegraded":"2024-09-12T02:34:08.562242+0000","last_fullsized":"2024-09-12T02:34:08.562242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:24.977490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265581+0000","last_change":"2024-09-12T02:34:00.056061+0000","last_active":"2024-09-12T02:34:07.265581+0000","last_peered":"2024-09-12T02:34:07.265581+0000","last_clean":"2024-09-12T02:34:07.265581+0000","last_became_active":"2024-09-12T02:34:00.055702+0000","last_became_peered":"2024-09-12T02:34:00.055702+0000","last_unstale":"2024-09-12T02:34:07.265581+0000","last_undegraded":"2024-09-12T02:34:07.265581+0000","last_fullsized":"2024-09-12T02:34:07.265581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266184+0000","last_change":"2024-09-12T02:34:05.658591+0000","last_active":"2024-09-12T02:34:07.266184+0000","last_peered":"2024-09-12T02:34:07.266184+0000","last_clean":"2024-09-12T02:34:07.266184+0000","last_became_active":"2024-09-12T02:34:05.658221+0000","last_became_peered":"2024-09-12T02:34:05.658221+0000","last_unstale":"2024-09-12T02:34:07.266184+0000","last_undegraded":"2024-09-12T02:34:07.266184+0000","last_fullsized":"2024-09-12T02:34:07.266184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095029+0000","last_change":"2024-09-12T02:34:01.063254+0000","last_active":"2024-09-12T02:34:07.095029+0000","last_peered":"2024-09-12T02:34:07.095029+0000","last_clean":"2024-09-12T02:34:07.095029+0000","last_became_active":"2024-09-12T02:34:01.062975+0000","last_became_peered":"2024-09-12T02:34:01.062975+0000","last_unstale":"2024-09-12T02:34:07.095029+0000","last_undegraded":"2024-09-12T02:34:07.095029+0000","last_fullsized":"2024-09-12T02:34:07.095029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:58.049718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835835+0000","last_change":"2024-09-12T02:34:00.060051+0000","last_active":"2024-09-12T02:34:08.835835+0000","last_peered":"2024-09-12T02:34:08.835835+0000","last_clean":"2024-09-12T02:34:08.835835+0000","last_became_active":"2024-09-12T02:34:00.059298+0000","last_became_peered":"2024-09-12T02:34:00.059298+0000","last_unstale":"2024-09-12T02:34:08.835835+0000","last_undegraded":"2024-09-12T02:34:08.835835+0000","last_fullsized":"2024-09-12T02:34:08.835835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094722+0000","last_change":"2024-09-12T02:34:05.080851+0000","last_active":"2024-09-12T02:34:07.094722+0000","last_peered":"2024-09-12T02:34:07.094722+0000","last_clean":"2024-09-12T02:34:07.094722+0000","last_became_active":"2024-09-12T02:34:05.080409+0000","last_became_peered":"2024-09-12T02:34:05.080409+0000","last_unstale":"2024-09-12T02:34:07.094722+0000","last_undegraded":"2024-09-12T02:34:07.094722+0000","last_fullsized":"2024-09-12T02:34:07.094722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347589+0000","last_change":"2024-09-12T02:34:01.052544+0000","last_active":"2024-09-12T02:34:07.347589+0000","last_peered":"2024-09-12T02:34:07.347589+0000","last_clean":"2024-09-12T02:34:07.347589+0000","last_became_active":"2024-09-12T02:34:01.052248+0000","last_became_peered":"2024-09-12T02:34:01.052248+0000","last_unstale":"2024-09-12T02:34:07.347589+0000","last_undegraded":"2024-09-12T02:34:07.347589+0000","last_fullsized":"2024-09-12T02:34:07.347589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095474+0000","last_change":"2024-09-12T02:34:00.056829+0000","last_active":"2024-09-12T02:34:07.095474+0000","last_peered":"2024-09-12T02:34:07.095474+0000","last_clean":"2024-09-12T02:34:07.095474+0000","last_became_active":"2024-09-12T02:34:00.056507+0000","last_became_peered":"2024-09-12T02:34:00.056507+0000","last_unstale":"2024-09-12T02:34:07.095474+0000","last_undegraded":"2024-09-12T02:34:07.095474+0000","last_fullsized":"2024-09-12T02:34:07.095474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094358+0000","last_change":"2024-09-12T02:34:05.658703+0000","last_active":"2024-09-12T02:34:07.094358+0000","last_peered":"2024-09-12T02:34:07.094358+0000","last_clean":"2024-09-12T02:34:07.094358+0000","last_became_active":"2024-09-12T02:34:05.658284+0000","last_became_peered":"2024-09-12T02:34:05.658284+0000","last_unstale":"2024-09-12T02:34:07.094358+0000","last_undegraded":"2024-09-12T02:34:07.094358+0000","last_fullsized":"2024-09-12T02:34:07.094358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562853+0000","last_change":"2024-09-12T02:34:01.062483+0000","last_active":"2024-09-12T02:34:08.562853+0000","last_peered":"2024-09-12T02:34:08.562853+0000","last_clean":"2024-09-12T02:34:08.562853+0000","last_became_active":"2024-09-12T02:34:01.062172+0000","last_became_peered":"2024-09-12T02:34:01.062172+0000","last_unstale":"2024-09-12T02:34:08.562853+0000","last_undegraded":"2024-09-12T02:34:08.562853+0000","last_fullsized":"2024-09-12T02:34:08.562853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:34.983530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266195+0000","last_change":"2024-09-12T02:34:00.052655+0000","last_active":"2024-09-12T02:34:07.266195+0000","last_peered":"2024-09-12T02:34:07.266195+0000","last_clean":"2024-09-12T02:34:07.266195+0000","last_became_active":"2024-09-12T02:34:00.051516+0000","last_became_peered":"2024-09-12T02:34:00.051516+0000","last_unstale":"2024-09-12T02:34:07.266195+0000","last_undegraded":"2024-09-12T02:34:07.266195+0000","last_fullsized":"2024-09-12T02:34:07.266195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562000+0000","last_change":"2024-09-12T02:34:05.658723+0000","last_active":"2024-09-12T02:34:08.562000+0000","last_peered":"2024-09-12T02:34:08.562000+0000","last_clean":"2024-09-12T02:34:08.562000+0000","last_became_active":"2024-09-12T02:34:05.658328+0000","last_became_peered":"2024-09-12T02:34:05.658328+0000","last_unstale":"2024-09-12T02:34:08.562000+0000","last_undegraded":"2024-09-12T02:34:08.562000+0000","last_fullsized":"2024-09-12T02:34:08.562000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.652938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.050206+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049932+0000","last_became_peered":"2024-09-12T02:34:01.049932+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835876+0000","last_change":"2024-09-12T02:34:00.060227+0000","last_active":"2024-09-12T02:34:08.835876+0000","last_peered":"2024-09-12T02:34:08.835876+0000","last_clean":"2024-09-12T02:34:08.835876+0000","last_became_active":"2024-09-12T02:34:00.059857+0000","last_became_peered":"2024-09-12T02:34:00.059857+0000","last_unstale":"2024-09-12T02:34:08.835876+0000","last_undegraded":"2024-09-12T02:34:08.835876+0000","last_fullsized":"2024-09-12T02:34:08.835876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:35.697987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347145+0000","last_change":"2024-09-12T02:34:05.656856+0000","last_active":"2024-09-12T02:34:07.347145+0000","last_peered":"2024-09-12T02:34:07.347145+0000","last_clean":"2024-09-12T02:34:07.347145+0000","last_became_active":"2024-09-12T02:34:05.656368+0000","last_became_peered":"2024-09-12T02:34:05.656368+0000","last_unstale":"2024-09-12T02:34:07.347145+0000","last_undegraded":"2024-09-12T02:34:07.347145+0000","last_fullsized":"2024-09-12T02:34:07.347145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896211+0000","last_change":"2024-09-12T02:34:01.064917+0000","last_active":"2024-09-12T02:34:07.896211+0000","last_peered":"2024-09-12T02:34:07.896211+0000","last_clean":"2024-09-12T02:34:07.896211+0000","last_became_active":"2024-09-12T02:34:01.064584+0000","last_became_peered":"2024-09-12T02:34:01.064584+0000","last_unstale":"2024-09-12T02:34:07.896211+0000","last_undegraded":"2024-09-12T02:34:07.896211+0000","last_fullsized":"2024-09-12T02:34:07.896211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266024+0000","last_change":"2024-09-12T02:34:00.058032+0000","last_active":"2024-09-12T02:34:07.266024+0000","last_peered":"2024-09-12T02:34:07.266024+0000","last_clean":"2024-09-12T02:34:07.266024+0000","last_became_active":"2024-09-12T02:34:00.057761+0000","last_became_peered":"2024-09-12T02:34:00.057761+0000","last_unstale":"2024-09-12T02:34:07.266024+0000","last_undegraded":"2024-09-12T02:34:07.266024+0000","last_fullsized":"2024-09-12T02:34:07.266024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265571+0000","last_change":"2024-09-12T02:34:05.084537+0000","last_active":"2024-09-12T02:34:07.265571+0000","last_peered":"2024-09-12T02:34:07.265571+0000","last_clean":"2024-09-12T02:34:07.265571+0000","last_became_active":"2024-09-12T02:34:05.084024+0000","last_became_peered":"2024-09-12T02:34:05.084024+0000","last_unstale":"2024-09-12T02:34:07.265571+0000","last_undegraded":"2024-09-12T02:34:07.265571+0000","last_fullsized":"2024-09-12T02:34:07.265571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095347+0000","last_change":"2024-09-12T02:34:01.062564+0000","last_active":"2024-09-12T02:34:07.095347+0000","last_peered":"2024-09-12T02:34:07.095347+0000","last_clean":"2024-09-12T02:34:07.095347+0000","last_became_active":"2024-09-12T02:34:01.062007+0000","last_became_peered":"2024-09-12T02:34:01.062007+0000","last_unstale":"2024-09-12T02:34:07.095347+0000","last_undegraded":"2024-09-12T02:34:07.095347+0000","last_fullsized":"2024-09-12T02:34:07.095347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:57.201089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896147+0000","last_change":"2024-09-12T02:34:00.057767+0000","last_active":"2024-09-12T02:34:07.896147+0000","last_peered":"2024-09-12T02:34:07.896147+0000","last_clean":"2024-09-12T02:34:07.896147+0000","last_became_active":"2024-09-12T02:34:00.057309+0000","last_became_peered":"2024-09-12T02:34:00.057309+0000","last_unstale":"2024-09-12T02:34:07.896147+0000","last_undegraded":"2024-09-12T02:34:07.896147+0000","last_fullsized":"2024-09-12T02:34:07.896147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265935+0000","last_change":"2024-09-12T02:34:05.080386+0000","last_active":"2024-09-12T02:34:07.265935+0000","last_peered":"2024-09-12T02:34:07.265935+0000","last_clean":"2024-09-12T02:34:07.265935+0000","last_became_active":"2024-09-12T02:34:05.079869+0000","last_became_peered":"2024-09-12T02:34:05.079869+0000","last_unstale":"2024-09-12T02:34:07.265935+0000","last_undegraded":"2024-09-12T02:34:07.265935+0000","last_fullsized":"2024-09-12T02:34:07.265935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265585+0000","last_change":"2024-09-12T02:34:01.048210+0000","last_active":"2024-09-12T02:34:07.265585+0000","last_peered":"2024-09-12T02:34:07.265585+0000","last_clean":"2024-09-12T02:34:07.265585+0000","last_became_active":"2024-09-12T02:34:01.047883+0000","last_became_peered":"2024-09-12T02:34:01.047883+0000","last_unstale":"2024-09-12T02:34:07.265585+0000","last_undegraded":"2024-09-12T02:34:07.265585+0000","last_fullsized":"2024-09-12T02:34:07.265585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090263+0000","last_change":"2024-09-12T02:34:00.052517+0000","last_active":"2024-09-12T02:34:07.090263+0000","last_peered":"2024-09-12T02:34:07.090263+0000","last_clean":"2024-09-12T02:34:07.090263+0000","last_became_active":"2024-09-12T02:34:00.052229+0000","last_became_peered":"2024-09-12T02:34:00.052229+0000","last_unstale":"2024-09-12T02:34:07.090263+0000","last_undegraded":"2024-09-12T02:34:07.090263+0000","last_fullsized":"2024-09-12T02:34:07.090263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:52.608734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266180+0000","last_change":"2024-09-12T02:34:05.079492+0000","last_active":"2024-09-12T02:34:07.266180+0000","last_peered":"2024-09-12T02:34:07.266180+0000","last_clean":"2024-09-12T02:34:07.266180+0000","last_became_active":"2024-09-12T02:34:05.079114+0000","last_became_peered":"2024-09-12T02:34:05.079114+0000","last_unstale":"2024-09-12T02:34:07.266180+0000","last_undegraded":"2024-09-12T02:34:07.266180+0000","last_fullsized":"2024-09-12T02:34:07.266180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.346986+0000","last_change":"2024-09-12T02:34:01.057070+0000","last_active":"2024-09-12T02:34:07.346986+0000","last_peered":"2024-09-12T02:34:07.346986+0000","last_clean":"2024-09-12T02:34:07.346986+0000","last_became_active":"2024-09-12T02:34:01.056658+0000","last_became_peered":"2024-09-12T02:34:01.056658+0000","last_unstale":"2024-09-12T02:34:07.346986+0000","last_undegraded":"2024-09-12T02:34:07.346986+0000","last_fullsized":"2024-09-12T02:34:07.346986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.216224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835827+0000","last_change":"2024-09-12T02:34:00.061960+0000","last_active":"2024-09-12T02:34:08.835827+0000","last_peered":"2024-09-12T02:34:08.835827+0000","last_clean":"2024-09-12T02:34:08.835827+0000","last_became_active":"2024-09-12T02:34:00.061710+0000","last_became_peered":"2024-09-12T02:34:00.061710+0000","last_unstale":"2024-09-12T02:34:08.835827+0000","last_undegraded":"2024-09-12T02:34:08.835827+0000","last_fullsized":"2024-09-12T02:34:08.835827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347500+0000","last_change":"2024-09-12T02:34:05.658955+0000","last_active":"2024-09-12T02:34:07.347500+0000","last_peered":"2024-09-12T02:34:07.347500+0000","last_clean":"2024-09-12T02:34:07.347500+0000","last_became_active":"2024-09-12T02:34:05.657958+0000","last_became_peered":"2024-09-12T02:34:05.657958+0000","last_unstale":"2024-09-12T02:34:07.347500+0000","last_undegraded":"2024-09-12T02:34:07.347500+0000","last_fullsized":"2024-09-12T02:34:07.347500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562253+0000","last_change":"2024-09-12T02:34:01.067308+0000","last_active":"2024-09-12T02:34:08.562253+0000","last_peered":"2024-09-12T02:34:08.562253+0000","last_clean":"2024-09-12T02:34:08.562253+0000","last_became_active":"2024-09-12T02:34:01.066973+0000","last_became_peered":"2024-09-12T02:34:01.066973+0000","last_unstale":"2024-09-12T02:34:08.562253+0000","last_undegraded":"2024-09-12T02:34:08.562253+0000","last_fullsized":"2024-09-12T02:34:08.562253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.656076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895930+0000","last_change":"2024-09-12T02:34:00.055611+0000","last_active":"2024-09-12T02:34:07.895930+0000","last_peered":"2024-09-12T02:34:07.895930+0000","last_clean":"2024-09-12T02:34:07.895930+0000","last_became_active":"2024-09-12T02:34:00.055344+0000","last_became_peered":"2024-09-12T02:34:00.055344+0000","last_unstale":"2024-09-12T02:34:07.895930+0000","last_undegraded":"2024-09-12T02:34:07.895930+0000","last_fullsized":"2024-09-12T02:34:07.895930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836209+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:08.836209+0000","last_peered":"2024-09-12T02:34:08.836209+0000","last_clean":"2024-09-12T02:34:08.836209+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:08.836209+0000","last_undegraded":"2024-09-12T02:34:08.836209+0000","last_fullsized":"2024-09-12T02:34:08.836209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095519+0000","last_change":"2024-09-12T02:34:05.658756+0000","last_active":"2024-09-12T02:34:07.095519+0000","last_peered":"2024-09-12T02:34:07.095519+0000","last_clean":"2024-09-12T02:34:07.095519+0000","last_became_active":"2024-09-12T02:34:05.658203+0000","last_became_peered":"2024-09-12T02:34:05.658203+0000","last_unstale":"2024-09-12T02:34:07.095519+0000","last_undegraded":"2024-09-12T02:34:07.095519+0000","last_fullsized":"2024-09-12T02:34:07.095519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836636+0000","last_change":"2024-09-12T02:34:01.069608+0000","last_active":"2024-09-12T02:34:08.836636+0000","last_peered":"2024-09-12T02:34:08.836636+0000","last_clean":"2024-09-12T02:34:08.836636+0000","last_became_active":"2024-09-12T02:34:01.069122+0000","last_became_peered":"2024-09-12T02:34:01.069122+0000","last_unstale":"2024-09-12T02:34:08.836636+0000","last_undegraded":"2024-09-12T02:34:08.836636+0000","last_fullsized":"2024-09-12T02:34:08.836636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090639+0000","last_change":"2024-09-12T02:34:00.054247+0000","last_active":"2024-09-12T02:34:07.090639+0000","last_peered":"2024-09-12T02:34:07.090639+0000","last_clean":"2024-09-12T02:34:07.090639+0000","last_became_active":"2024-09-12T02:34:00.053946+0000","last_became_peered":"2024-09-12T02:34:00.053946+0000","last_unstale":"2024-09-12T02:34:07.090639+0000","last_undegraded":"2024-09-12T02:34:07.090639+0000","last_fullsized":"2024-09-12T02:34:07.090639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:07.754916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:05.656456+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:05.656039+0000","last_became_peered":"2024-09-12T02:34:05.656039+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.059721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895983+0000","last_change":"2024-09-12T02:34:01.066544+0000","last_active":"2024-09-12T02:34:07.895983+0000","last_peered":"2024-09-12T02:34:07.895983+0000","last_clean":"2024-09-12T02:34:07.895983+0000","last_became_active":"2024-09-12T02:34:01.065801+0000","last_became_peered":"2024-09-12T02:34:01.065801+0000","last_unstale":"2024-09-12T02:34:07.895983+0000","last_undegraded":"2024-09-12T02:34:07.895983+0000","last_fullsized":"2024-09-12T02:34:07.895983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266060+0000","last_change":"2024-09-12T02:34:00.053363+0000","last_active":"2024-09-12T02:34:07.266060+0000","last_peered":"2024-09-12T02:34:07.266060+0000","last_clean":"2024-09-12T02:34:07.266060+0000","last_became_active":"2024-09-12T02:34:00.053091+0000","last_became_peered":"2024-09-12T02:34:00.053091+0000","last_unstale":"2024-09-12T02:34:07.266060+0000","last_undegraded":"2024-09-12T02:34:07.266060+0000","last_fullsized":"2024-09-12T02:34:07.266060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347382+0000","last_change":"2024-09-12T02:34:05.083388+0000","last_active":"2024-09-12T02:34:07.347382+0000","last_peered":"2024-09-12T02:34:07.347382+0000","last_clean":"2024-09-12T02:34:07.347382+0000","last_became_active":"2024-09-12T02:34:05.082457+0000","last_became_peered":"2024-09-12T02:34:05.082457+0000","last_unstale":"2024-09-12T02:34:07.347382+0000","last_undegraded":"2024-09-12T02:34:07.347382+0000","last_fullsized":"2024-09-12T02:34:07.347382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836912+0000","last_change":"2024-09-12T02:34:01.074931+0000","last_active":"2024-09-12T02:34:08.836912+0000","last_peered":"2024-09-12T02:34:08.836912+0000","last_clean":"2024-09-12T02:34:08.836912+0000","last_became_active":"2024-09-12T02:34:01.074653+0000","last_became_peered":"2024-09-12T02:34:01.074653+0000","last_unstale":"2024-09-12T02:34:08.836912+0000","last_undegraded":"2024-09-12T02:34:08.836912+0000","last_fullsized":"2024-09-12T02:34:08.836912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:43.458949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090480+0000","last_change":"2024-09-12T02:34:00.055519+0000","last_active":"2024-09-12T02:34:07.090480+0000","last_peered":"2024-09-12T02:34:07.090480+0000","last_clean":"2024-09-12T02:34:07.090480+0000","last_became_active":"2024-09-12T02:34:00.055196+0000","last_became_peered":"2024-09-12T02:34:00.055196+0000","last_unstale":"2024-09-12T02:34:07.090480+0000","last_undegraded":"2024-09-12T02:34:07.090480+0000","last_fullsized":"2024-09-12T02:34:07.090480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.742903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895518+0000","last_change":"2024-09-12T02:34:05.658643+0000","last_active":"2024-09-12T02:34:07.895518+0000","last_peered":"2024-09-12T02:34:07.895518+0000","last_clean":"2024-09-12T02:34:07.895518+0000","last_became_active":"2024-09-12T02:34:05.658201+0000","last_became_peered":"2024-09-12T02:34:05.658201+0000","last_unstale":"2024-09-12T02:34:07.895518+0000","last_undegraded":"2024-09-12T02:34:07.895518+0000","last_fullsized":"2024-09-12T02:34:07.895518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.544978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836870+0000","last_change":"2024-09-12T02:34:01.068158+0000","last_active":"2024-09-12T02:34:08.836870+0000","last_peered":"2024-09-12T02:34:08.836870+0000","last_clean":"2024-09-12T02:34:08.836870+0000","last_became_active":"2024-09-12T02:34:01.067814+0000","last_became_peered":"2024-09-12T02:34:01.067814+0000","last_unstale":"2024-09-12T02:34:08.836870+0000","last_undegraded":"2024-09-12T02:34:08.836870+0000","last_fullsized":"2024-09-12T02:34:08.836870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095425+0000","last_change":"2024-09-12T02:34:00.057323+0000","last_active":"2024-09-12T02:34:07.095425+0000","last_peered":"2024-09-12T02:34:07.095425+0000","last_clean":"2024-09-12T02:34:07.095425+0000","last_became_active":"2024-09-12T02:34:00.057029+0000","last_became_peered":"2024-09-12T02:34:00.057029+0000","last_unstale":"2024-09-12T02:34:07.095425+0000","last_undegraded":"2024-09-12T02:34:07.095425+0000","last_fullsized":"2024-09-12T02:34:07.095425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:59.639173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094272+0000","last_change":"2024-09-12T02:34:05.079794+0000","last_active":"2024-09-12T02:34:07.094272+0000","last_peered":"2024-09-12T02:34:07.094272+0000","last_clean":"2024-09-12T02:34:07.094272+0000","last_became_active":"2024-09-12T02:34:05.079405+0000","last_became_peered":"2024-09-12T02:34:05.079405+0000","last_unstale":"2024-09-12T02:34:07.094272+0000","last_undegraded":"2024-09-12T02:34:07.094272+0000","last_fullsized":"2024-09-12T02:34:07.094272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836441+0000","last_change":"2024-09-12T02:34:01.057423+0000","last_active":"2024-09-12T02:34:08.836441+0000","last_peered":"2024-09-12T02:34:08.836441+0000","last_clean":"2024-09-12T02:34:08.836441+0000","last_became_active":"2024-09-12T02:34:01.057128+0000","last_became_peered":"2024-09-12T02:34:01.057128+0000","last_unstale":"2024-09-12T02:34:08.836441+0000","last_undegraded":"2024-09-12T02:34:08.836441+0000","last_fullsized":"2024-09-12T02:34:08.836441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090168+0000","last_change":"2024-09-12T02:34:00.048532+0000","last_active":"2024-09-12T02:34:07.090168+0000","last_peered":"2024-09-12T02:34:07.090168+0000","last_clean":"2024-09-12T02:34:07.090168+0000","last_became_active":"2024-09-12T02:34:00.048245+0000","last_became_peered":"2024-09-12T02:34:00.048245+0000","last_unstale":"2024-09-12T02:34:07.090168+0000","last_undegraded":"2024-09-12T02:34:07.090168+0000","last_fullsized":"2024-09-12T02:34:07.090168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:23.482609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347436+0000","last_change":"2024-09-12T02:34:05.079264+0000","last_active":"2024-09-12T02:34:07.347436+0000","last_peered":"2024-09-12T02:34:07.347436+0000","last_clean":"2024-09-12T02:34:07.347436+0000","last_became_active":"2024-09-12T02:34:05.078754+0000","last_became_peered":"2024-09-12T02:34:05.078754+0000","last_unstale":"2024-09-12T02:34:07.347436+0000","last_undegraded":"2024-09-12T02:34:07.347436+0000","last_fullsized":"2024-09-12T02:34:07.347436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094120+0000","last_change":"2024-09-12T02:34:01.060623+0000","last_active":"2024-09-12T02:34:07.094120+0000","last_peered":"2024-09-12T02:34:07.094120+0000","last_clean":"2024-09-12T02:34:07.094120+0000","last_became_active":"2024-09-12T02:34:01.060339+0000","last_became_peered":"2024-09-12T02:34:01.060339+0000","last_unstale":"2024-09-12T02:34:07.094120+0000","last_undegraded":"2024-09-12T02:34:07.094120+0000","last_fullsized":"2024-09-12T02:34:07.094120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:00.051189+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:00.050920+0000","last_became_peered":"2024-09-12T02:34:00.050920+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562819+0000","last_change":"2024-09-12T02:34:05.658569+0000","last_active":"2024-09-12T02:34:08.562819+0000","last_peered":"2024-09-12T02:34:08.562819+0000","last_clean":"2024-09-12T02:34:08.562819+0000","last_became_active":"2024-09-12T02:34:05.658174+0000","last_became_peered":"2024-09-12T02:34:05.658174+0000","last_unstale":"2024-09-12T02:34:08.562819+0000","last_undegraded":"2024-09-12T02:34:08.562819+0000","last_fullsized":"2024-09-12T02:34:08.562819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:28.956735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836570+0000","last_change":"2024-09-12T02:34:01.065005+0000","last_active":"2024-09-12T02:34:08.836570+0000","last_peered":"2024-09-12T02:34:08.836570+0000","last_clean":"2024-09-12T02:34:08.836570+0000","last_became_active":"2024-09-12T02:34:01.064722+0000","last_became_peered":"2024-09-12T02:34:01.064722+0000","last_unstale":"2024-09-12T02:34:08.836570+0000","last_undegraded":"2024-09-12T02:34:08.836570+0000","last_fullsized":"2024-09-12T02:34:08.836570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895958+0000","last_change":"2024-09-12T02:34:00.058485+0000","last_active":"2024-09-12T02:34:07.895958+0000","last_peered":"2024-09-12T02:34:07.895958+0000","last_clean":"2024-09-12T02:34:07.895958+0000","last_became_active":"2024-09-12T02:34:00.058013+0000","last_became_peered":"2024-09-12T02:34:00.058013+0000","last_unstale":"2024-09-12T02:34:07.895958+0000","last_undegraded":"2024-09-12T02:34:07.895958+0000","last_fullsized":"2024-09-12T02:34:07.895958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562509+0000","last_change":"2024-09-12T02:34:05.659437+0000","last_active":"2024-09-12T02:34:08.562509+0000","last_peered":"2024-09-12T02:34:08.562509+0000","last_clean":"2024-09-12T02:34:08.562509+0000","last_became_active":"2024-09-12T02:34:05.658091+0000","last_became_peered":"2024-09-12T02:34:05.658091+0000","last_unstale":"2024-09-12T02:34:08.562509+0000","last_undegraded":"2024-09-12T02:34:08.562509+0000","last_fullsized":"2024-09-12T02:34:08.562509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:49.468958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347237+0000","last_change":"2024-09-12T02:34:01.058834+0000","last_active":"2024-09-12T02:34:07.347237+0000","last_peered":"2024-09-12T02:34:07.347237+0000","last_clean":"2024-09-12T02:34:07.347237+0000","last_became_active":"2024-09-12T02:34:01.058557+0000","last_became_peered":"2024-09-12T02:34:01.058557+0000","last_unstale":"2024-09-12T02:34:07.347237+0000","last_undegraded":"2024-09-12T02:34:07.347237+0000","last_fullsized":"2024-09-12T02:34:07.347237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347544+0000","last_change":"2024-09-12T02:34:00.057001+0000","last_active":"2024-09-12T02:34:07.347544+0000","last_peered":"2024-09-12T02:34:07.347544+0000","last_clean":"2024-09-12T02:34:07.347544+0000","last_became_active":"2024-09-12T02:34:00.056685+0000","last_became_peered":"2024-09-12T02:34:00.056685+0000","last_unstale":"2024-09-12T02:34:07.347544+0000","last_undegraded":"2024-09-12T02:34:07.347544+0000","last_fullsized":"2024-09-12T02:34:07.347544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.793722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896082+0000","last_change":"2024-09-12T02:34:05.660619+0000","last_active":"2024-09-12T02:34:07.896082+0000","last_peered":"2024-09-12T02:34:07.896082+0000","last_clean":"2024-09-12T02:34:07.896082+0000","last_became_active":"2024-09-12T02:34:05.659790+0000","last_became_peered":"2024-09-12T02:34:05.659790+0000","last_unstale":"2024-09-12T02:34:07.896082+0000","last_undegraded":"2024-09-12T02:34:07.896082+0000","last_fullsized":"2024-09-12T02:34:07.896082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:38.472945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836579+0000","last_change":"2024-09-12T02:34:01.069392+0000","last_active":"2024-09-12T02:34:08.836579+0000","last_peered":"2024-09-12T02:34:08.836579+0000","last_clean":"2024-09-12T02:34:08.836579+0000","last_became_active":"2024-09-12T02:34:01.069065+0000","last_became_peered":"2024-09-12T02:34:01.069065+0000","last_unstale":"2024-09-12T02:34:08.836579+0000","last_undegraded":"2024-09-12T02:34:08.836579+0000","last_fullsized":"2024-09-12T02:34:08.836579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:10.464560+0000","last_change":"2024-09-12T02:34:00.058230+0000","last_active":"2024-09-12T02:34:10.464560+0000","last_peered":"2024-09-12T02:34:10.464560+0000","last_clean":"2024-09-12T02:34:10.464560+0000","last_became_active":"2024-09-12T02:34:00.057965+0000","last_became_peered":"2024-09-12T02:34:00.057965+0000","last_unstale":"2024-09-12T02:34:10.464560+0000","last_undegraded":"2024-09-12T02:34:10.464560+0000","last_fullsized":"2024-09-12T02:34:10.464560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265696+0000","last_change":"2024-09-12T02:34:05.084205+0000","last_active":"2024-09-12T02:34:07.265696+0000","last_peered":"2024-09-12T02:34:07.265696+0000","last_clean":"2024-09-12T02:34:07.265696+0000","last_became_active":"2024-09-12T02:34:05.083830+0000","last_became_peered":"2024-09-12T02:34:05.083830+0000","last_unstale":"2024-09-12T02:34:07.265696+0000","last_undegraded":"2024-09-12T02:34:07.265696+0000","last_fullsized":"2024-09-12T02:34:07.265696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095341+0000","last_change":"2024-09-12T02:34:01.059209+0000","last_active":"2024-09-12T02:34:07.095341+0000","last_peered":"2024-09-12T02:34:07.095341+0000","last_clean":"2024-09-12T02:34:07.095341+0000","last_became_active":"2024-09-12T02:34:01.058918+0000","last_became_peered":"2024-09-12T02:34:01.058918+0000","last_unstale":"2024-09-12T02:34:07.095341+0000","last_undegraded":"2024-09-12T02:34:07.095341+0000","last_fullsized":"2024-09-12T02:34:07.095341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.313534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266057+0000","last_change":"2024-09-12T02:34:00.054000+0000","last_active":"2024-09-12T02:34:07.266057+0000","last_peered":"2024-09-12T02:34:07.266057+0000","last_clean":"2024-09-12T02:34:07.266057+0000","last_became_active":"2024-09-12T02:34:00.053740+0000","last_became_peered":"2024-09-12T02:34:00.053740+0000","last_unstale":"2024-09-12T02:34:07.266057+0000","last_undegraded":"2024-09-12T02:34:07.266057+0000","last_fullsized":"2024-09-12T02:34:07.266057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094290+0000","last_change":"2024-09-12T02:34:05.076783+0000","last_active":"2024-09-12T02:34:07.094290+0000","last_peered":"2024-09-12T02:34:07.094290+0000","last_clean":"2024-09-12T02:34:07.094290+0000","last_became_active":"2024-09-12T02:34:05.076363+0000","last_became_peered":"2024-09-12T02:34:05.076363+0000","last_unstale":"2024-09-12T02:34:07.094290+0000","last_undegraded":"2024-09-12T02:34:07.094290+0000","last_fullsized":"2024-09-12T02:34:07.094290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:25.870250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347370+0000","last_change":"2024-09-12T02:34:01.066781+0000","last_active":"2024-09-12T02:34:07.347370+0000","last_peered":"2024-09-12T02:34:07.347370+0000","last_clean":"2024-09-12T02:34:07.347370+0000","last_became_active":"2024-09-12T02:34:01.066488+0000","last_became_peered":"2024-09-12T02:34:01.066488+0000","last_unstale":"2024-09-12T02:34:07.347370+0000","last_undegraded":"2024-09-12T02:34:07.347370+0000","last_fullsized":"2024-09-12T02:34:07.347370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896103+0000","last_change":"2024-09-12T02:34:00.053362+0000","last_active":"2024-09-12T02:34:07.896103+0000","last_peered":"2024-09-12T02:34:07.896103+0000","last_clean":"2024-09-12T02:34:07.896103+0000","last_became_active":"2024-09-12T02:34:00.053065+0000","last_became_peered":"2024-09-12T02:34:00.053065+0000","last_unstale":"2024-09-12T02:34:07.896103+0000","last_undegraded":"2024-09-12T02:34:07.896103+0000","last_fullsized":"2024-09-12T02:34:07.896103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562161+0000","last_change":"2024-09-12T02:34:05.078084+0000","last_active":"2024-09-12T02:34:08.562161+0000","last_peered":"2024-09-12T02:34:08.562161+0000","last_clean":"2024-09-12T02:34:08.562161+0000","last_became_active":"2024-09-12T02:34:05.077651+0000","last_became_peered":"2024-09-12T02:34:05.077651+0000","last_unstale":"2024-09-12T02:34:08.562161+0000","last_undegraded":"2024-09-12T02:34:08.562161+0000","last_fullsized":"2024-09-12T02:34:08.562161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:12.453888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896027+0000","last_change":"2024-09-12T02:34:01.069626+0000","last_active":"2024-09-12T02:34:07.896027+0000","last_peered":"2024-09-12T02:34:07.896027+0000","last_clean":"2024-09-12T02:34:07.896027+0000","last_became_active":"2024-09-12T02:34:01.069377+0000","last_became_peered":"2024-09-12T02:34:01.069377+0000","last_unstale":"2024-09-12T02:34:07.896027+0000","last_undegraded":"2024-09-12T02:34:07.896027+0000","last_fullsized":"2024-09-12T02:34:07.896027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:00.054287+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:00.054015+0000","last_became_peered":"2024-09-12T02:34:00.054015+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562172+0000","last_change":"2024-09-12T02:34:05.662260+0000","last_active":"2024-09-12T02:34:08.562172+0000","last_peered":"2024-09-12T02:34:08.562172+0000","last_clean":"2024-09-12T02:34:08.562172+0000","last_became_active":"2024-09-12T02:34:05.662024+0000","last_became_peered":"2024-09-12T02:34:05.662024+0000","last_unstale":"2024-09-12T02:34:08.562172+0000","last_undegraded":"2024-09-12T02:34:08.562172+0000","last_fullsized":"2024-09-12T02:34:08.562172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:58.165661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347329+0000","last_change":"2024-09-12T02:34:05.659237+0000","last_active":"2024-09-12T02:34:07.347329+0000","last_peered":"2024-09-12T02:34:07.347329+0000","last_clean":"2024-09-12T02:34:07.347329+0000","last_became_active":"2024-09-12T02:34:05.658549+0000","last_became_peered":"2024-09-12T02:34:05.658549+0000","last_unstale":"2024-09-12T02:34:07.347329+0000","last_undegraded":"2024-09-12T02:34:07.347329+0000","last_fullsized":"2024-09-12T02:34:07.347329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265465+0000","last_change":"2024-09-12T02:34:01.053018+0000","last_active":"2024-09-12T02:34:07.265465+0000","last_peered":"2024-09-12T02:34:07.265465+0000","last_clean":"2024-09-12T02:34:07.265465+0000","last_became_active":"2024-09-12T02:34:01.052640+0000","last_became_peered":"2024-09-12T02:34:01.052640+0000","last_unstale":"2024-09-12T02:34:07.265465+0000","last_undegraded":"2024-09-12T02:34:07.265465+0000","last_fullsized":"2024-09-12T02:34:07.265465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895717+0000","last_change":"2024-09-12T02:34:00.059071+0000","last_active":"2024-09-12T02:34:07.895717+0000","last_peered":"2024-09-12T02:34:07.895717+0000","last_clean":"2024-09-12T02:34:07.895717+0000","last_became_active":"2024-09-12T02:34:00.058712+0000","last_became_peered":"2024-09-12T02:34:00.058712+0000","last_unstale":"2024-09-12T02:34:07.895717+0000","last_undegraded":"2024-09-12T02:34:07.895717+0000","last_fullsized":"2024-09-12T02:34:07.895717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:05.078933+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:05.078471+0000","last_became_peered":"2024-09-12T02:34:05.078471+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562145+0000","last_change":"2024-09-12T02:34:01.062159+0000","last_active":"2024-09-12T02:34:08.562145+0000","last_peered":"2024-09-12T02:34:08.562145+0000","last_clean":"2024-09-12T02:34:08.562145+0000","last_became_active":"2024-09-12T02:34:01.061853+0000","last_became_peered":"2024-09-12T02:34:01.061853+0000","last_unstale":"2024-09-12T02:34:08.562145+0000","last_undegraded":"2024-09-12T02:34:08.562145+0000","last_fullsized":"2024-09-12T02:34:08.562145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:30.820938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561699+0000","last_change":"2024-09-12T02:34:00.059938+0000","last_active":"2024-09-12T02:34:08.561699+0000","last_peered":"2024-09-12T02:34:08.561699+0000","last_clean":"2024-09-12T02:34:08.561699+0000","last_became_active":"2024-09-12T02:34:00.059625+0000","last_became_peered":"2024-09-12T02:34:00.059625+0000","last_unstale":"2024-09-12T02:34:08.561699+0000","last_undegraded":"2024-09-12T02:34:08.561699+0000","last_fullsized":"2024-09-12T02:34:08.561699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:40.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094779+0000","last_change":"2024-09-12T02:34:00.048853+0000","last_active":"2024-09-12T02:34:07.094779+0000","last_peered":"2024-09-12T02:34:07.094779+0000","last_clean":"2024-09-12T02:34:07.094779+0000","last_became_active":"2024-09-12T02:34:00.048563+0000","last_became_peered":"2024-09-12T02:34:00.048563+0000","last_unstale":"2024-09-12T02:34:07.094779+0000","last_undegraded":"2024-09-12T02:34:07.094779+0000","last_fullsized":"2024-09-12T02:34:07.094779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.056880+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.056573+0000","last_became_peered":"2024-09-12T02:34:01.056573+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090610+0000","last_change":"2024-09-12T02:34:05.079707+0000","last_active":"2024-09-12T02:34:07.090610+0000","last_peered":"2024-09-12T02:34:07.090610+0000","last_clean":"2024-09-12T02:34:07.090610+0000","last_became_active":"2024-09-12T02:34:05.079349+0000","last_became_peered":"2024-09-12T02:34:05.079349+0000","last_unstale":"2024-09-12T02:34:07.090610+0000","last_undegraded":"2024-09-12T02:34:07.090610+0000","last_fullsized":"2024-09-12T02:34:07.090610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:17.011167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562431+0000","last_change":"2024-09-12T02:34:00.057281+0000","last_active":"2024-09-12T02:34:08.562431+0000","last_peered":"2024-09-12T02:34:08.562431+0000","last_clean":"2024-09-12T02:34:08.562431+0000","last_became_active":"2024-09-12T02:34:00.057004+0000","last_became_peered":"2024-09-12T02:34:00.057004+0000","last_unstale":"2024-09-12T02:34:08.562431+0000","last_undegraded":"2024-09-12T02:34:08.562431+0000","last_fullsized":"2024-09-12T02:34:08.562431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:23.045646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094064+0000","last_change":"2024-09-12T02:34:01.056167+0000","last_active":"2024-09-12T02:34:07.094064+0000","last_peered":"2024-09-12T02:34:07.094064+0000","last_clean":"2024-09-12T02:34:07.094064+0000","last_became_active":"2024-09-12T02:34:01.055914+0000","last_became_peered":"2024-09-12T02:34:01.055914+0000","last_unstale":"2024-09-12T02:34:07.094064+0000","last_undegraded":"2024-09-12T02:34:07.094064+0000","last_fullsized":"2024-09-12T02:34:07.094064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:06.967072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562579+0000","last_change":"2024-09-12T02:34:05.078328+0000","last_active":"2024-09-12T02:34:08.562579+0000","last_peered":"2024-09-12T02:34:08.562579+0000","last_clean":"2024-09-12T02:34:08.562579+0000","last_became_active":"2024-09-12T02:34:05.077613+0000","last_became_peered":"2024-09-12T02:34:05.077613+0000","last_unstale":"2024-09-12T02:34:08.562579+0000","last_undegraded":"2024-09-12T02:34:08.562579+0000","last_fullsized":"2024-09-12T02:34:08.562579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.567364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093915+0000","last_change":"2024-09-12T02:34:01.061088+0000","last_active":"2024-09-12T02:34:07.093915+0000","last_peered":"2024-09-12T02:34:07.093915+0000","last_clean":"2024-09-12T02:34:07.093915+0000","last_became_active":"2024-09-12T02:34:01.060388+0000","last_became_peered":"2024-09-12T02:34:01.060388+0000","last_unstale":"2024-09-12T02:34:07.093915+0000","last_undegraded":"2024-09-12T02:34:07.093915+0000","last_fullsized":"2024-09-12T02:34:07.093915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090261+0000","last_change":"2024-09-12T02:34:01.057775+0000","last_active":"2024-09-12T02:34:07.090261+0000","last_peered":"2024-09-12T02:34:07.090261+0000","last_clean":"2024-09-12T02:34:07.090261+0000","last_became_active":"2024-09-12T02:34:01.057444+0000","last_became_peered":"2024-09-12T02:34:01.057444+0000","last_unstale":"2024-09-12T02:34:07.090261+0000","last_undegraded":"2024-09-12T02:34:07.090261+0000","last_fullsized":"2024-09-12T02:34:07.090261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:59.156424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895959+0000","last_change":"2024-09-12T02:34:01.064983+0000","last_active":"2024-09-12T02:34:07.895959+0000","last_peered":"2024-09-12T02:34:07.895959+0000","last_clean":"2024-09-12T02:34:07.895959+0000","last_became_active":"2024-09-12T02:34:01.064526+0000","last_became_peered":"2024-09-12T02:34:01.064526+0000","last_unstale":"2024-09-12T02:34:07.895959+0000","last_undegraded":"2024-09-12T02:34:07.895959+0000","last_fullsized":"2024-09-12T02:34:07.895959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.055170+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.054896+0000","last_became_peered":"2024-09-12T02:34:01.054896+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562609+0000","last_change":"2024-09-12T02:34:01.058376+0000","last_active":"2024-09-12T02:34:08.562609+0000","last_peered":"2024-09-12T02:34:08.562609+0000","last_clean":"2024-09-12T02:34:08.562609+0000","last_became_active":"2024-09-12T02:34:01.058094+0000","last_became_peered":"2024-09-12T02:34:01.058094+0000","last_unstale":"2024-09-12T02:34:08.562609+0000","last_undegraded":"2024-09-12T02:34:08.562609+0000","last_fullsized":"2024-09-12T02:34:08.562609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:23.542579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.049857+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049533+0000","last_became_peered":"2024-09-12T02:34:01.049533+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095094+0000","last_change":"2024-09-12T02:34:01.059501+0000","last_active":"2024-09-12T02:34:07.095094+0000","last_peered":"2024-09-12T02:34:07.095094+0000","last_clean":"2024-09-12T02:34:07.095094+0000","last_became_active":"2024-09-12T02:34:01.059225+0000","last_became_peered":"2024-09-12T02:34:01.059225+0000","last_unstale":"2024-09-12T02:34:07.095094+0000","last_undegraded":"2024-09-12T02:34:07.095094+0000","last_fullsized":"2024-09-12T02:34:07.095094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562804+0000","last_change":"2024-09-12T02:34:01.055984+0000","last_active":"2024-09-12T02:34:08.562804+0000","last_peered":"2024-09-12T02:34:08.562804+0000","last_clean":"2024-09-12T02:34:08.562804+0000","last_became_active":"2024-09-12T02:34:01.055717+0000","last_became_peered":"2024-09-12T02:34:01.055717+0000","last_unstale":"2024-09-12T02:34:08.562804+0000","last_undegraded":"2024-09-12T02:34:08.562804+0000","last_fullsized":"2024-09-12T02:34:08.562804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895650+0000","last_change":"2024-09-12T02:34:01.065533+0000","last_active":"2024-09-12T02:34:07.895650+0000","last_peered":"2024-09-12T02:34:07.895650+0000","last_clean":"2024-09-12T02:34:07.895650+0000","last_became_active":"2024-09-12T02:34:01.065247+0000","last_became_peered":"2024-09-12T02:34:01.065247+0000","last_unstale":"2024-09-12T02:34:07.895650+0000","last_undegraded":"2024-09-12T02:34:07.895650+0000","last_fullsized":"2024-09-12T02:34:07.895650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:40.545417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562279+0000","last_change":"2024-09-12T02:34:01.056565+0000","last_active":"2024-09-12T02:34:08.562279+0000","last_peered":"2024-09-12T02:34:08.562279+0000","last_clean":"2024-09-12T02:34:08.562279+0000","last_became_active":"2024-09-12T02:34:01.056227+0000","last_became_peered":"2024-09-12T02:34:01.056227+0000","last_unstale":"2024-09-12T02:34:08.562279+0000","last_undegraded":"2024-09-12T02:34:08.562279+0000","last_fullsized":"2024-09-12T02:34:08.562279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:47.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895752+0000","last_change":"2024-09-12T02:34:01.070313+0000","last_active":"2024-09-12T02:34:07.895752+0000","last_peered":"2024-09-12T02:34:07.895752+0000","last_clean":"2024-09-12T02:34:07.895752+0000","last_became_active":"2024-09-12T02:34:01.070031+0000","last_became_peered":"2024-09-12T02:34:01.070031+0000","last_unstale":"2024-09-12T02:34:07.895752+0000","last_undegraded":"2024-09-12T02:34:07.895752+0000","last_fullsized":"2024-09-12T02:34:07.895752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:59.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347244+0000","last_change":"2024-09-12T02:34:01.060012+0000","last_active":"2024-09-12T02:34:07.347244+0000","last_peered":"2024-09-12T02:34:07.347244+0000","last_clean":"2024-09-12T02:34:07.347244+0000","last_became_active":"2024-09-12T02:34:01.059756+0000","last_became_peered":"2024-09-12T02:34:01.059756+0000","last_unstale":"2024-09-12T02:34:07.347244+0000","last_undegraded":"2024-09-12T02:34:07.347244+0000","last_fullsized":"2024-09-12T02:34:07.347244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.654168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094908+0000","last_change":"2024-09-12T02:34:01.056798+0000","last_active":"2024-09-12T02:34:07.094908+0000","last_peered":"2024-09-12T02:34:07.094908+0000","last_clean":"2024-09-12T02:34:07.094908+0000","last_became_active":"2024-09-12T02:34:01.056523+0000","last_became_peered":"2024-09-12T02:34:01.056523+0000","last_unstale":"2024-09-12T02:34:07.094908+0000","last_undegraded":"2024-09-12T02:34:07.094908+0000","last_fullsized":"2024-09-12T02:34:07.094908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836766+0000","last_change":"2024-09-12T02:34:01.069679+0000","last_active":"2024-09-12T02:34:08.836766+0000","last_peered":"2024-09-12T02:34:08.836766+0000","last_clean":"2024-09-12T02:34:08.836766+0000","last_became_active":"2024-09-12T02:34:01.069397+0000","last_became_peered":"2024-09-12T02:34:01.069397+0000","last_unstale":"2024-09-12T02:34:08.836766+0000","last_undegraded":"2024-09-12T02:34:08.836766+0000","last_fullsized":"2024-09-12T02:34:08.836766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:08.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090422+0000","last_change":"2024-09-12T02:34:01.054994+0000","last_active":"2024-09-12T02:34:07.090422+0000","last_peered":"2024-09-12T02:34:07.090422+0000","last_clean":"2024-09-12T02:34:07.090422+0000","last_became_active":"2024-09-12T02:34:01.054724+0000","last_became_peered":"2024-09-12T02:34:01.054724+0000","last_unstale":"2024-09-12T02:34:07.090422+0000","last_undegraded":"2024-09-12T02:34:07.090422+0000","last_fullsized":"2024-09-12T02:34:07.090422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:34.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896338+0000","last_change":"2024-09-12T02:34:01.076336+0000","last_active":"2024-09-12T02:34:07.896338+0000","last_peered":"2024-09-12T02:34:07.896338+0000","last_clean":"2024-09-12T02:34:07.896338+0000","last_became_active":"2024-09-12T02:34:01.075961+0000","last_became_peered":"2024-09-12T02:34:01.075961+0000","last_unstale":"2024-09-12T02:34:07.896338+0000","last_undegraded":"2024-09-12T02:34:07.896338+0000","last_fullsized":"2024-09-12T02:34:07.896338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895531+0000","last_change":"2024-09-12T02:34:01.067021+0000","last_active":"2024-09-12T02:34:07.895531+0000","last_peered":"2024-09-12T02:34:07.895531+0000","last_clean":"2024-09-12T02:34:07.895531+0000","last_became_active":"2024-09-12T02:34:01.065834+0000","last_became_peered":"2024-09-12T02:34:01.065834+0000","last_unstale":"2024-09-12T02:34:07.895531+0000","last_undegraded":"2024-09-12T02:34:07.895531+0000","last_fullsized":"2024-09-12T02:34:07.895531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265540+0000","last_change":"2024-09-12T02:34:01.052768+0000","last_active":"2024-09-12T02:34:07.265540+0000","last_peered":"2024-09-12T02:34:07.265540+0000","last_clean":"2024-09-12T02:34:07.265540+0000","last_became_active":"2024-09-12T02:34:01.052482+0000","last_became_peered":"2024-09-12T02:34:01.052482+0000","last_unstale":"2024-09-12T02:34:07.265540+0000","last_undegraded":"2024-09-12T02:34:07.265540+0000","last_fullsized":"2024-09-12T02:34:07.265540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347203+0000","last_change":"2024-09-12T02:34:01.055910+0000","last_active":"2024-09-12T02:34:07.347203+0000","last_peered":"2024-09-12T02:34:07.347203+0000","last_clean":"2024-09-12T02:34:07.347203+0000","last_became_active":"2024-09-12T02:34:01.055652+0000","last_became_peered":"2024-09-12T02:34:01.055652+0000","last_unstale":"2024-09-12T02:34:07.347203+0000","last_undegraded":"2024-09-12T02:34:07.347203+0000","last_fullsized":"2024-09-12T02:34:07.347203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:30.649532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562369+0000","last_change":"2024-09-12T02:34:01.061023+0000","last_active":"2024-09-12T02:34:08.562369+0000","last_peered":"2024-09-12T02:34:08.562369+0000","last_clean":"2024-09-12T02:34:08.562369+0000","last_became_active":"2024-09-12T02:34:01.060672+0000","last_became_peered":"2024-09-12T02:34:01.060672+0000","last_unstale":"2024-09-12T02:34:08.562369+0000","last_undegraded":"2024-09-12T02:34:08.562369+0000","last_fullsized":"2024-09-12T02:34:08.562369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.491024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095250+0000","last_change":"2024-09-12T02:34:01.061215+0000","last_active":"2024-09-12T02:34:07.095250+0000","last_peered":"2024-09-12T02:34:07.095250+0000","last_clean":"2024-09-12T02:34:07.095250+0000","last_became_active":"2024-09-12T02:34:01.060951+0000","last_became_peered":"2024-09-12T02:34:01.060951+0000","last_unstale":"2024-09-12T02:34:07.095250+0000","last_undegraded":"2024-09-12T02:34:07.095250+0000","last_fullsized":"2024-09-12T02:34:07.095250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:13.069032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095546+0000","last_change":"2024-09-12T02:34:01.070066+0000","last_active":"2024-09-12T02:34:07.095546+0000","last_peered":"2024-09-12T02:34:07.095546+0000","last_clean":"2024-09-12T02:34:07.095546+0000","last_became_active":"2024-09-12T02:34:01.069783+0000","last_became_peered":"2024-09-12T02:34:01.069783+0000","last_unstale":"2024-09-12T02:34:07.095546+0000","last_undegraded":"2024-09-12T02:34:07.095546+0000","last_fullsized":"2024-09-12T02:34:07.095546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094984+0000","last_change":"2024-09-12T02:34:01.070083+0000","last_active":"2024-09-12T02:34:07.094984+0000","last_peered":"2024-09-12T02:34:07.094984+0000","last_clean":"2024-09-12T02:34:07.094984+0000","last_became_active":"2024-09-12T02:34:01.069808+0000","last_became_peered":"2024-09-12T02:34:01.069808+0000","last_unstale":"2024-09-12T02:34:07.094984+0000","last_undegraded":"2024-09-12T02:34:07.094984+0000","last_fullsized":"2024-09-12T02:34:07.094984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836872+0000","last_change":"2024-09-12T02:34:01.074865+0000","last_active":"2024-09-12T02:34:08.836872+0000","last_peered":"2024-09-12T02:34:08.836872+0000","last_clean":"2024-09-12T02:34:08.836872+0000","last_became_active":"2024-09-12T02:34:01.074473+0000","last_became_peered":"2024-09-12T02:34:01.074473+0000","last_unstale":"2024-09-12T02:34:08.836872+0000","last_undegraded":"2024-09-12T02:34:08.836872+0000","last_fullsized":"2024-09-12T02:34:08.836872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:21.843182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562043+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:08.562043+0000","last_peered":"2024-09-12T02:34:08.562043+0000","last_clean":"2024-09-12T02:34:08.562043+0000","last_became_active":"2024-09-12T02:34:01.067024+0000","last_became_peered":"2024-09-12T02:34:01.067024+0000","last_unstale":"2024-09-12T02:34:08.562043+0000","last_undegraded":"2024-09-12T02:34:08.562043+0000","last_fullsized":"2024-09-12T02:34:08.562043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:56.143361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836303+0000","last_change":"2024-09-12T02:34:01.058244+0000","last_active":"2024-09-12T02:34:08.836303+0000","last_peered":"2024-09-12T02:34:08.836303+0000","last_clean":"2024-09-12T02:34:08.836303+0000","last_became_active":"2024-09-12T02:34:01.057968+0000","last_became_peered":"2024-09-12T02:34:01.057968+0000","last_unstale":"2024-09-12T02:34:08.836303+0000","last_undegraded":"2024-09-12T02:34:08.836303+0000","last_fullsized":"2024-09-12T02:34:08.836303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895748+0000","last_change":"2024-09-12T02:34:01.067464+0000","last_active":"2024-09-12T02:34:07.895748+0000","last_peered":"2024-09-12T02:34:07.895748+0000","last_clean":"2024-09-12T02:34:07.895748+0000","last_became_active":"2024-09-12T02:34:01.065862+0000","last_became_peered":"2024-09-12T02:34:01.065862+0000","last_unstale":"2024-09-12T02:34:07.895748+0000","last_undegraded":"2024-09-12T02:34:07.895748+0000","last_fullsized":"2024-09-12T02:34:07.895748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836442+0000","last_change":"2024-09-12T02:34:01.068831+0000","last_active":"2024-09-12T02:34:08.836442+0000","last_peered":"2024-09-12T02:34:08.836442+0000","last_clean":"2024-09-12T02:34:08.836442+0000","last_became_active":"2024-09-12T02:34:01.066724+0000","last_became_peered":"2024-09-12T02:34:01.066724+0000","last_unstale":"2024-09-12T02:34:08.836442+0000","last_undegraded":"2024-09-12T02:34:08.836442+0000","last_fullsized":"2024-09-12T02:34:08.836442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895852+0000","last_change":"2024-09-12T02:34:01.065590+0000","last_active":"2024-09-12T02:34:07.895852+0000","last_peered":"2024-09-12T02:34:07.895852+0000","last_clean":"2024-09-12T02:34:07.895852+0000","last_became_active":"2024-09-12T02:34:01.065308+0000","last_became_peered":"2024-09-12T02:34:01.065308+0000","last_unstale":"2024-09-12T02:34:07.895852+0000","last_undegraded":"2024-09-12T02:34:07.895852+0000","last_fullsized":"2024-09-12T02:34:07.895852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347223+0000","last_change":"2024-09-12T02:34:01.056168+0000","last_active":"2024-09-12T02:34:07.347223+0000","last_peered":"2024-09-12T02:34:07.347223+0000","last_clean":"2024-09-12T02:34:07.347223+0000","last_became_active":"2024-09-12T02:34:01.055731+0000","last_became_peered":"2024-09-12T02:34:01.055731+0000","last_unstale":"2024-09-12T02:34:07.347223+0000","last_undegraded":"2024-09-12T02:34:07.347223+0000","last_fullsized":"2024-09-12T02:34:07.347223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266139+0000","last_change":"2024-09-12T02:34:01.060961+0000","last_active":"2024-09-12T02:34:07.266139+0000","last_peered":"2024-09-12T02:34:07.266139+0000","last_clean":"2024-09-12T02:34:07.266139+0000","last_became_active":"2024-09-12T02:34:01.060669+0000","last_became_peered":"2024-09-12T02:34:01.060669+0000","last_unstale":"2024-09-12T02:34:07.266139+0000","last_undegraded":"2024-09-12T02:34:07.266139+0000","last_fullsized":"2024-09-12T02:34:07.266139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836765+0000","last_change":"2024-09-12T02:34:01.074156+0000","last_active":"2024-09-12T02:34:08.836765+0000","last_peered":"2024-09-12T02:34:08.836765+0000","last_clean":"2024-09-12T02:34:08.836765+0000","last_became_active":"2024-09-12T02:34:01.073860+0000","last_became_peered":"2024-09-12T02:34:01.073860+0000","last_unstale":"2024-09-12T02:34:08.836765+0000","last_undegraded":"2024-09-12T02:34:08.836765+0000","last_fullsized":"2024-09-12T02:34:08.836765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476748,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":704005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":113181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":113215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":704061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":113055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:23.795 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:23.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.928+0000 7fb41da8d640 1 Processor -- start 2024-09-12T02:34:23.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.928+0000 7fb41da8d640 1 -- start start 2024-09-12T02:34:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb41da8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb41da8d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4180b64c0 0x7fb41806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb41da8d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180d3690 con 0x7fb41815e5f0 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb41da8d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb41806d530 con 0x7fb4180b64c0 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb41da8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180d3970 con 0x7fb4180d30f0 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4180b64c0 0x7fb41806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4180b64c0 0x7fb41806d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57076/0 (socket says 172.21.15.119:57076) 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 -- 172.21.15.119:0/4098195240 learned_addr learned my addr 172.21.15.119:0/4098195240 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb416ffd640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 -- 172.21.15.119:0/4098195240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 msgr2=0x7fb4180b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 -- 172.21.15.119:0/4098195240 >> v1:172.21.15.153:6789/0 conn(0x7fb41815e5f0 legacy=0x7fb4180d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.929+0000 7fb417fff640 1 -- 172.21.15.119:0/4098195240 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41806cee0 con 0x7fb4180b64c0 2024-09-12T02:34:23.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.930+0000 7fb417fff640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4180b64c0 0x7fb41806d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb410009e50 tx=0x7fb41002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e995dc7d37de9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.930+0000 7fb4167fc640 1 -- 172.21.15.119:0/4098195240 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410036070 con 0x7fb4180b64c0 2024-09-12T02:34:23.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.930+0000 7fb4167fc640 1 -- 172.21.15.119:0/4098195240 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410031600 con 0x7fb4180b64c0 2024-09-12T02:34:23.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.930+0000 7fb4167fc640 1 -- 172.21.15.119:0/4098195240 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100319d0 con 0x7fb4180b64c0 2024-09-12T02:34:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 -- 172.21.15.119:0/4098195240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4180b64c0 msgr2=0x7fb41806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4180b64c0 0x7fb41806d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb410009e50 tx=0x7fb41002a710 comp rx=0 tx=0).stop 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 -- 172.21.15.119:0/4098195240 shutdown_connections 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4180b64c0 0x7fb41806d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4098195240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 -- 172.21.15.119:0/4098195240 >> 172.21.15.119:0/4098195240 conn(0x7fb41808bfc0 msgr2=0x7fb4180d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 -- 172.21.15.119:0/4098195240 shutdown_connections 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.931+0000 7fb41da8d640 1 -- 172.21.15.119:0/4098195240 wait complete. 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.932+0000 7fb41da8d640 1 Processor -- start 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.932+0000 7fb41da8d640 1 -- start start 2024-09-12T02:34:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4180b64c0 0x7fb41814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb41806df00 con 0x7fb41815e5f0 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb41815e9d0 con 0x7fb4180b64c0 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb41da8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb41806e080 con 0x7fb4180d30f0 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57092/0 (socket says 172.21.15.119:57092) 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 -- 172.21.15.119:0/4007689866 learned_addr learned my addr 172.21.15.119:0/4007689866 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb416ffd640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb4177fe640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4180b64c0 0x7fb41814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 -- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 msgr2=0x7fb4180b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 -- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4180b64c0 msgr2=0x7fb41814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4180b64c0 0x7fb41814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 -- 172.21.15.119:0/4007689866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41814e7c0 con 0x7fb41815e5f0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb417fff640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb410009e50 tx=0x7fb410004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.933+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410036050 con 0x7fb41815e5f0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.934+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410042070 con 0x7fb41815e5f0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.934+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4180b8540 con 0x7fb41815e5f0 2024-09-12T02:34:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.934+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410009510 con 0x7fb41815e5f0 2024-09-12T02:34:23.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.934+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4180b8b00 con 0x7fb41815e5f0 2024-09-12T02:34:23.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.934+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4180d2d20 con 0x7fb41815e5f0 2024-09-12T02:34:23.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.935+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb410007bf0 con 0x7fb41815e5f0 2024-09-12T02:34:23.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.935+0000 7fb3fffff640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 0x7fb40406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.936+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb4100abfa0 con 0x7fb41815e5f0 2024-09-12T02:34:23.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.936+0000 7fb4177fe640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 0x7fb40406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.936+0000 7fb4177fe640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 0x7fb40406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb4080016e0 tx=0x7fb408009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:23.940+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4180d2d20 con 0x7fb41815e5f0 2024-09-12T02:34:24.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.104+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb418161da0 con 0x7fb40406be30 2024-09-12T02:34:24.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.111+0000 7fb3fffff640 1 -- 172.21.15.119:0/4007689866 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fb418161da0 con 0x7fb40406be30 2024-09-12T02:34:24.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:24.117 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:24.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 msgr2=0x7fb40406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 0x7fb40406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb4080016e0 tx=0x7fb408009040 comp rx=0 tx=0).stop 2024-09-12T02:34:24.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 msgr2=0x7fb4180cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb410009e50 tx=0x7fb410004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 shutdown_connections 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40406be30 0x7fb40406e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41815e5f0 0x7fb4180cb5d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4180d30f0 0x7fb4180b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 --2- 172.21.15.119:0/4007689866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4180b64c0 0x7fb41814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 >> 172.21.15.119:0/4007689866 conn(0x7fb41808bfc0 msgr2=0x7fb4180ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 shutdown_connections 2024-09-12T02:34:24.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.115+0000 7fb41da8d640 1 -- 172.21.15.119:0/4007689866 wait complete. 2024-09-12T02:34:24.126 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-12T02:34:23.183552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219636,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755084,"statfs":{"total":773094113280,"available":772869206016,"internally_reserved":0,"allocated":3481600,"data_stored":2094460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003544"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347397+0000","last_change":"2024-09-12T02:34:00.057067+0000","last_active":"2024-09-12T02:34:07.347397+0000","last_peered":"2024-09-12T02:34:07.347397+0000","last_clean":"2024-09-12T02:34:07.347397+0000","last_became_active":"2024-09-12T02:34:00.056766+0000","last_became_peered":"2024-09-12T02:34:00.056766+0000","last_unstale":"2024-09-12T02:34:07.347397+0000","last_undegraded":"2024-09-12T02:34:07.347397+0000","last_fullsized":"2024-09-12T02:34:07.347397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:36.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562594+0000","last_change":"2024-09-12T02:34:01.061517+0000","last_active":"2024-09-12T02:34:08.562594+0000","last_peered":"2024-09-12T02:34:08.562594+0000","last_clean":"2024-09-12T02:34:08.562594+0000","last_became_active":"2024-09-12T02:34:01.061120+0000","last_became_peered":"2024-09-12T02:34:01.061120+0000","last_unstale":"2024-09-12T02:34:08.562594+0000","last_undegraded":"2024-09-12T02:34:08.562594+0000","last_fullsized":"2024-09-12T02:34:08.562594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:18.386298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562151+0000","last_change":"2024-09-12T02:34:05.658529+0000","last_active":"2024-09-12T02:34:08.562151+0000","last_peered":"2024-09-12T02:34:08.562151+0000","last_clean":"2024-09-12T02:34:08.562151+0000","last_became_active":"2024-09-12T02:34:05.658141+0000","last_became_peered":"2024-09-12T02:34:05.658141+0000","last_unstale":"2024-09-12T02:34:08.562151+0000","last_undegraded":"2024-09-12T02:34:08.562151+0000","last_fullsized":"2024-09-12T02:34:08.562151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:35.123440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561735+0000","last_change":"2024-09-12T02:34:00.059738+0000","last_active":"2024-09-12T02:34:08.561735+0000","last_peered":"2024-09-12T02:34:08.561735+0000","last_clean":"2024-09-12T02:34:08.561735+0000","last_became_active":"2024-09-12T02:34:00.059507+0000","last_became_peered":"2024-09-12T02:34:00.059507+0000","last_unstale":"2024-09-12T02:34:08.561735+0000","last_undegraded":"2024-09-12T02:34:08.561735+0000","last_fullsized":"2024-09-12T02:34:08.561735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347277+0000","last_change":"2024-09-12T02:34:01.066517+0000","last_active":"2024-09-12T02:34:07.347277+0000","last_peered":"2024-09-12T02:34:07.347277+0000","last_clean":"2024-09-12T02:34:07.347277+0000","last_became_active":"2024-09-12T02:34:01.066244+0000","last_became_peered":"2024-09-12T02:34:01.066244+0000","last_unstale":"2024-09-12T02:34:07.347277+0000","last_undegraded":"2024-09-12T02:34:07.347277+0000","last_fullsized":"2024-09-12T02:34:07.347277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094181+0000","last_change":"2024-09-12T02:34:05.080417+0000","last_active":"2024-09-12T02:34:07.094181+0000","last_peered":"2024-09-12T02:34:07.094181+0000","last_clean":"2024-09-12T02:34:07.094181+0000","last_became_active":"2024-09-12T02:34:05.079990+0000","last_became_peered":"2024-09-12T02:34:05.079990+0000","last_unstale":"2024-09-12T02:34:07.094181+0000","last_undegraded":"2024-09-12T02:34:07.094181+0000","last_fullsized":"2024-09-12T02:34:07.094181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:13.003179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835917+0000","last_change":"2024-09-12T02:34:00.065442+0000","last_active":"2024-09-12T02:34:08.835917+0000","last_peered":"2024-09-12T02:34:08.835917+0000","last_clean":"2024-09-12T02:34:08.835917+0000","last_became_active":"2024-09-12T02:34:00.065146+0000","last_became_peered":"2024-09-12T02:34:00.065146+0000","last_unstale":"2024-09-12T02:34:08.835917+0000","last_undegraded":"2024-09-12T02:34:08.835917+0000","last_fullsized":"2024-09-12T02:34:08.835917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:05.525436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895899+0000","last_change":"2024-09-12T02:34:01.063766+0000","last_active":"2024-09-12T02:34:07.895899+0000","last_peered":"2024-09-12T02:34:07.895899+0000","last_clean":"2024-09-12T02:34:07.895899+0000","last_became_active":"2024-09-12T02:34:01.063502+0000","last_became_peered":"2024-09-12T02:34:01.063502+0000","last_unstale":"2024-09-12T02:34:07.895899+0000","last_undegraded":"2024-09-12T02:34:07.895899+0000","last_fullsized":"2024-09-12T02:34:07.895899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093971+0000","last_change":"2024-09-12T02:34:05.079431+0000","last_active":"2024-09-12T02:34:07.093971+0000","last_peered":"2024-09-12T02:34:07.093971+0000","last_clean":"2024-09-12T02:34:07.093971+0000","last_became_active":"2024-09-12T02:34:05.079067+0000","last_became_peered":"2024-09-12T02:34:05.079067+0000","last_unstale":"2024-09-12T02:34:07.093971+0000","last_undegraded":"2024-09-12T02:34:07.093971+0000","last_fullsized":"2024-09-12T02:34:07.093971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835848+0000","last_change":"2024-09-12T02:34:00.061054+0000","last_active":"2024-09-12T02:34:08.835848+0000","last_peered":"2024-09-12T02:34:08.835848+0000","last_clean":"2024-09-12T02:34:08.835848+0000","last_became_active":"2024-09-12T02:34:00.060797+0000","last_became_peered":"2024-09-12T02:34:00.060797+0000","last_unstale":"2024-09-12T02:34:08.835848+0000","last_undegraded":"2024-09-12T02:34:08.835848+0000","last_fullsized":"2024-09-12T02:34:08.835848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896093+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:07.896093+0000","last_peered":"2024-09-12T02:34:07.896093+0000","last_clean":"2024-09-12T02:34:07.896093+0000","last_became_active":"2024-09-12T02:34:01.067112+0000","last_became_peered":"2024-09-12T02:34:01.067112+0000","last_unstale":"2024-09-12T02:34:07.896093+0000","last_undegraded":"2024-09-12T02:34:07.896093+0000","last_fullsized":"2024-09-12T02:34:07.896093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093944+0000","last_change":"2024-09-12T02:34:05.077446+0000","last_active":"2024-09-12T02:34:07.093944+0000","last_peered":"2024-09-12T02:34:07.093944+0000","last_clean":"2024-09-12T02:34:07.093944+0000","last_became_active":"2024-09-12T02:34:05.077106+0000","last_became_peered":"2024-09-12T02:34:05.077106+0000","last_unstale":"2024-09-12T02:34:07.093944+0000","last_undegraded":"2024-09-12T02:34:07.093944+0000","last_fullsized":"2024-09-12T02:34:07.093944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094605+0000","last_change":"2024-09-12T02:34:01.056215+0000","last_active":"2024-09-12T02:34:07.094605+0000","last_peered":"2024-09-12T02:34:07.094605+0000","last_clean":"2024-09-12T02:34:07.094605+0000","last_became_active":"2024-09-12T02:34:01.055913+0000","last_became_peered":"2024-09-12T02:34:01.055913+0000","last_unstale":"2024-09-12T02:34:07.094605+0000","last_undegraded":"2024-09-12T02:34:07.094605+0000","last_fullsized":"2024-09-12T02:34:07.094605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835838+0000","last_change":"2024-09-12T02:34:00.058795+0000","last_active":"2024-09-12T02:34:08.835838+0000","last_peered":"2024-09-12T02:34:08.835838+0000","last_clean":"2024-09-12T02:34:08.835838+0000","last_became_active":"2024-09-12T02:34:00.058542+0000","last_became_peered":"2024-09-12T02:34:00.058542+0000","last_unstale":"2024-09-12T02:34:08.835838+0000","last_undegraded":"2024-09-12T02:34:08.835838+0000","last_fullsized":"2024-09-12T02:34:08.835838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095266+0000","last_change":"2024-09-12T02:34:05.081285+0000","last_active":"2024-09-12T02:34:07.095266+0000","last_peered":"2024-09-12T02:34:07.095266+0000","last_clean":"2024-09-12T02:34:07.095266+0000","last_became_active":"2024-09-12T02:34:05.080737+0000","last_became_peered":"2024-09-12T02:34:05.080737+0000","last_unstale":"2024-09-12T02:34:07.095266+0000","last_undegraded":"2024-09-12T02:34:07.095266+0000","last_fullsized":"2024-09-12T02:34:07.095266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562380+0000","last_change":"2024-09-12T02:34:01.058977+0000","last_active":"2024-09-12T02:34:08.562380+0000","last_peered":"2024-09-12T02:34:08.562380+0000","last_clean":"2024-09-12T02:34:08.562380+0000","last_became_active":"2024-09-12T02:34:01.058631+0000","last_became_peered":"2024-09-12T02:34:01.058631+0000","last_unstale":"2024-09-12T02:34:08.562380+0000","last_undegraded":"2024-09-12T02:34:08.562380+0000","last_fullsized":"2024-09-12T02:34:08.562380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:31.239556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265847+0000","last_change":"2024-09-12T02:34:00.058689+0000","last_active":"2024-09-12T02:34:07.265847+0000","last_peered":"2024-09-12T02:34:07.265847+0000","last_clean":"2024-09-12T02:34:07.265847+0000","last_became_active":"2024-09-12T02:34:00.058428+0000","last_became_peered":"2024-09-12T02:34:00.058428+0000","last_unstale":"2024-09-12T02:34:07.265847+0000","last_undegraded":"2024-09-12T02:34:07.265847+0000","last_fullsized":"2024-09-12T02:34:07.265847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095071+0000","last_change":"2024-09-12T02:34:05.080503+0000","last_active":"2024-09-12T02:34:07.095071+0000","last_peered":"2024-09-12T02:34:07.095071+0000","last_clean":"2024-09-12T02:34:07.095071+0000","last_became_active":"2024-09-12T02:34:05.080079+0000","last_became_peered":"2024-09-12T02:34:05.080079+0000","last_unstale":"2024-09-12T02:34:07.095071+0000","last_undegraded":"2024-09-12T02:34:07.095071+0000","last_fullsized":"2024-09-12T02:34:07.095071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562242+0000","last_change":"2024-09-12T02:34:01.050151+0000","last_active":"2024-09-12T02:34:08.562242+0000","last_peered":"2024-09-12T02:34:08.562242+0000","last_clean":"2024-09-12T02:34:08.562242+0000","last_became_active":"2024-09-12T02:34:01.049816+0000","last_became_peered":"2024-09-12T02:34:01.049816+0000","last_unstale":"2024-09-12T02:34:08.562242+0000","last_undegraded":"2024-09-12T02:34:08.562242+0000","last_fullsized":"2024-09-12T02:34:08.562242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:24.977490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265581+0000","last_change":"2024-09-12T02:34:00.056061+0000","last_active":"2024-09-12T02:34:07.265581+0000","last_peered":"2024-09-12T02:34:07.265581+0000","last_clean":"2024-09-12T02:34:07.265581+0000","last_became_active":"2024-09-12T02:34:00.055702+0000","last_became_peered":"2024-09-12T02:34:00.055702+0000","last_unstale":"2024-09-12T02:34:07.265581+0000","last_undegraded":"2024-09-12T02:34:07.265581+0000","last_fullsized":"2024-09-12T02:34:07.265581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:57.043868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266184+0000","last_change":"2024-09-12T02:34:05.658591+0000","last_active":"2024-09-12T02:34:07.266184+0000","last_peered":"2024-09-12T02:34:07.266184+0000","last_clean":"2024-09-12T02:34:07.266184+0000","last_became_active":"2024-09-12T02:34:05.658221+0000","last_became_peered":"2024-09-12T02:34:05.658221+0000","last_unstale":"2024-09-12T02:34:07.266184+0000","last_undegraded":"2024-09-12T02:34:07.266184+0000","last_fullsized":"2024-09-12T02:34:07.266184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095029+0000","last_change":"2024-09-12T02:34:01.063254+0000","last_active":"2024-09-12T02:34:07.095029+0000","last_peered":"2024-09-12T02:34:07.095029+0000","last_clean":"2024-09-12T02:34:07.095029+0000","last_became_active":"2024-09-12T02:34:01.062975+0000","last_became_peered":"2024-09-12T02:34:01.062975+0000","last_unstale":"2024-09-12T02:34:07.095029+0000","last_undegraded":"2024-09-12T02:34:07.095029+0000","last_fullsized":"2024-09-12T02:34:07.095029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:58.049718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835835+0000","last_change":"2024-09-12T02:34:00.060051+0000","last_active":"2024-09-12T02:34:08.835835+0000","last_peered":"2024-09-12T02:34:08.835835+0000","last_clean":"2024-09-12T02:34:08.835835+0000","last_became_active":"2024-09-12T02:34:00.059298+0000","last_became_peered":"2024-09-12T02:34:00.059298+0000","last_unstale":"2024-09-12T02:34:08.835835+0000","last_undegraded":"2024-09-12T02:34:08.835835+0000","last_fullsized":"2024-09-12T02:34:08.835835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094722+0000","last_change":"2024-09-12T02:34:05.080851+0000","last_active":"2024-09-12T02:34:07.094722+0000","last_peered":"2024-09-12T02:34:07.094722+0000","last_clean":"2024-09-12T02:34:07.094722+0000","last_became_active":"2024-09-12T02:34:05.080409+0000","last_became_peered":"2024-09-12T02:34:05.080409+0000","last_unstale":"2024-09-12T02:34:07.094722+0000","last_undegraded":"2024-09-12T02:34:07.094722+0000","last_fullsized":"2024-09-12T02:34:07.094722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347589+0000","last_change":"2024-09-12T02:34:01.052544+0000","last_active":"2024-09-12T02:34:07.347589+0000","last_peered":"2024-09-12T02:34:07.347589+0000","last_clean":"2024-09-12T02:34:07.347589+0000","last_became_active":"2024-09-12T02:34:01.052248+0000","last_became_peered":"2024-09-12T02:34:01.052248+0000","last_unstale":"2024-09-12T02:34:07.347589+0000","last_undegraded":"2024-09-12T02:34:07.347589+0000","last_fullsized":"2024-09-12T02:34:07.347589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095474+0000","last_change":"2024-09-12T02:34:00.056829+0000","last_active":"2024-09-12T02:34:07.095474+0000","last_peered":"2024-09-12T02:34:07.095474+0000","last_clean":"2024-09-12T02:34:07.095474+0000","last_became_active":"2024-09-12T02:34:00.056507+0000","last_became_peered":"2024-09-12T02:34:00.056507+0000","last_unstale":"2024-09-12T02:34:07.095474+0000","last_undegraded":"2024-09-12T02:34:07.095474+0000","last_fullsized":"2024-09-12T02:34:07.095474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094358+0000","last_change":"2024-09-12T02:34:05.658703+0000","last_active":"2024-09-12T02:34:07.094358+0000","last_peered":"2024-09-12T02:34:07.094358+0000","last_clean":"2024-09-12T02:34:07.094358+0000","last_became_active":"2024-09-12T02:34:05.658284+0000","last_became_peered":"2024-09-12T02:34:05.658284+0000","last_unstale":"2024-09-12T02:34:07.094358+0000","last_undegraded":"2024-09-12T02:34:07.094358+0000","last_fullsized":"2024-09-12T02:34:07.094358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562853+0000","last_change":"2024-09-12T02:34:01.062483+0000","last_active":"2024-09-12T02:34:08.562853+0000","last_peered":"2024-09-12T02:34:08.562853+0000","last_clean":"2024-09-12T02:34:08.562853+0000","last_became_active":"2024-09-12T02:34:01.062172+0000","last_became_peered":"2024-09-12T02:34:01.062172+0000","last_unstale":"2024-09-12T02:34:08.562853+0000","last_undegraded":"2024-09-12T02:34:08.562853+0000","last_fullsized":"2024-09-12T02:34:08.562853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:34.983530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266195+0000","last_change":"2024-09-12T02:34:00.052655+0000","last_active":"2024-09-12T02:34:07.266195+0000","last_peered":"2024-09-12T02:34:07.266195+0000","last_clean":"2024-09-12T02:34:07.266195+0000","last_became_active":"2024-09-12T02:34:00.051516+0000","last_became_peered":"2024-09-12T02:34:00.051516+0000","last_unstale":"2024-09-12T02:34:07.266195+0000","last_undegraded":"2024-09-12T02:34:07.266195+0000","last_fullsized":"2024-09-12T02:34:07.266195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562000+0000","last_change":"2024-09-12T02:34:05.658723+0000","last_active":"2024-09-12T02:34:08.562000+0000","last_peered":"2024-09-12T02:34:08.562000+0000","last_clean":"2024-09-12T02:34:08.562000+0000","last_became_active":"2024-09-12T02:34:05.658328+0000","last_became_peered":"2024-09-12T02:34:05.658328+0000","last_unstale":"2024-09-12T02:34:08.562000+0000","last_undegraded":"2024-09-12T02:34:08.562000+0000","last_fullsized":"2024-09-12T02:34:08.562000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.652938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.050206+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049932+0000","last_became_peered":"2024-09-12T02:34:01.049932+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835876+0000","last_change":"2024-09-12T02:34:00.060227+0000","last_active":"2024-09-12T02:34:08.835876+0000","last_peered":"2024-09-12T02:34:08.835876+0000","last_clean":"2024-09-12T02:34:08.835876+0000","last_became_active":"2024-09-12T02:34:00.059857+0000","last_became_peered":"2024-09-12T02:34:00.059857+0000","last_unstale":"2024-09-12T02:34:08.835876+0000","last_undegraded":"2024-09-12T02:34:08.835876+0000","last_fullsized":"2024-09-12T02:34:08.835876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:35.697987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347145+0000","last_change":"2024-09-12T02:34:05.656856+0000","last_active":"2024-09-12T02:34:07.347145+0000","last_peered":"2024-09-12T02:34:07.347145+0000","last_clean":"2024-09-12T02:34:07.347145+0000","last_became_active":"2024-09-12T02:34:05.656368+0000","last_became_peered":"2024-09-12T02:34:05.656368+0000","last_unstale":"2024-09-12T02:34:07.347145+0000","last_undegraded":"2024-09-12T02:34:07.347145+0000","last_fullsized":"2024-09-12T02:34:07.347145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896211+0000","last_change":"2024-09-12T02:34:01.064917+0000","last_active":"2024-09-12T02:34:07.896211+0000","last_peered":"2024-09-12T02:34:07.896211+0000","last_clean":"2024-09-12T02:34:07.896211+0000","last_became_active":"2024-09-12T02:34:01.064584+0000","last_became_peered":"2024-09-12T02:34:01.064584+0000","last_unstale":"2024-09-12T02:34:07.896211+0000","last_undegraded":"2024-09-12T02:34:07.896211+0000","last_fullsized":"2024-09-12T02:34:07.896211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266024+0000","last_change":"2024-09-12T02:34:00.058032+0000","last_active":"2024-09-12T02:34:07.266024+0000","last_peered":"2024-09-12T02:34:07.266024+0000","last_clean":"2024-09-12T02:34:07.266024+0000","last_became_active":"2024-09-12T02:34:00.057761+0000","last_became_peered":"2024-09-12T02:34:00.057761+0000","last_unstale":"2024-09-12T02:34:07.266024+0000","last_undegraded":"2024-09-12T02:34:07.266024+0000","last_fullsized":"2024-09-12T02:34:07.266024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.307684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265571+0000","last_change":"2024-09-12T02:34:05.084537+0000","last_active":"2024-09-12T02:34:07.265571+0000","last_peered":"2024-09-12T02:34:07.265571+0000","last_clean":"2024-09-12T02:34:07.265571+0000","last_became_active":"2024-09-12T02:34:05.084024+0000","last_became_peered":"2024-09-12T02:34:05.084024+0000","last_unstale":"2024-09-12T02:34:07.265571+0000","last_undegraded":"2024-09-12T02:34:07.265571+0000","last_fullsized":"2024-09-12T02:34:07.265571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:34.800340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095347+0000","last_change":"2024-09-12T02:34:01.062564+0000","last_active":"2024-09-12T02:34:07.095347+0000","last_peered":"2024-09-12T02:34:07.095347+0000","last_clean":"2024-09-12T02:34:07.095347+0000","last_became_active":"2024-09-12T02:34:01.062007+0000","last_became_peered":"2024-09-12T02:34:01.062007+0000","last_unstale":"2024-09-12T02:34:07.095347+0000","last_undegraded":"2024-09-12T02:34:07.095347+0000","last_fullsized":"2024-09-12T02:34:07.095347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:57.201089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896147+0000","last_change":"2024-09-12T02:34:00.057767+0000","last_active":"2024-09-12T02:34:07.896147+0000","last_peered":"2024-09-12T02:34:07.896147+0000","last_clean":"2024-09-12T02:34:07.896147+0000","last_became_active":"2024-09-12T02:34:00.057309+0000","last_became_peered":"2024-09-12T02:34:00.057309+0000","last_unstale":"2024-09-12T02:34:07.896147+0000","last_undegraded":"2024-09-12T02:34:07.896147+0000","last_fullsized":"2024-09-12T02:34:07.896147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265935+0000","last_change":"2024-09-12T02:34:05.080386+0000","last_active":"2024-09-12T02:34:07.265935+0000","last_peered":"2024-09-12T02:34:07.265935+0000","last_clean":"2024-09-12T02:34:07.265935+0000","last_became_active":"2024-09-12T02:34:05.079869+0000","last_became_peered":"2024-09-12T02:34:05.079869+0000","last_unstale":"2024-09-12T02:34:07.265935+0000","last_undegraded":"2024-09-12T02:34:07.265935+0000","last_fullsized":"2024-09-12T02:34:07.265935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265585+0000","last_change":"2024-09-12T02:34:01.048210+0000","last_active":"2024-09-12T02:34:07.265585+0000","last_peered":"2024-09-12T02:34:07.265585+0000","last_clean":"2024-09-12T02:34:07.265585+0000","last_became_active":"2024-09-12T02:34:01.047883+0000","last_became_peered":"2024-09-12T02:34:01.047883+0000","last_unstale":"2024-09-12T02:34:07.265585+0000","last_undegraded":"2024-09-12T02:34:07.265585+0000","last_fullsized":"2024-09-12T02:34:07.265585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090263+0000","last_change":"2024-09-12T02:34:00.052517+0000","last_active":"2024-09-12T02:34:07.090263+0000","last_peered":"2024-09-12T02:34:07.090263+0000","last_clean":"2024-09-12T02:34:07.090263+0000","last_became_active":"2024-09-12T02:34:00.052229+0000","last_became_peered":"2024-09-12T02:34:00.052229+0000","last_unstale":"2024-09-12T02:34:07.090263+0000","last_undegraded":"2024-09-12T02:34:07.090263+0000","last_fullsized":"2024-09-12T02:34:07.090263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:52.608734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266180+0000","last_change":"2024-09-12T02:34:05.079492+0000","last_active":"2024-09-12T02:34:07.266180+0000","last_peered":"2024-09-12T02:34:07.266180+0000","last_clean":"2024-09-12T02:34:07.266180+0000","last_became_active":"2024-09-12T02:34:05.079114+0000","last_became_peered":"2024-09-12T02:34:05.079114+0000","last_unstale":"2024-09-12T02:34:07.266180+0000","last_undegraded":"2024-09-12T02:34:07.266180+0000","last_fullsized":"2024-09-12T02:34:07.266180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.346986+0000","last_change":"2024-09-12T02:34:01.057070+0000","last_active":"2024-09-12T02:34:07.346986+0000","last_peered":"2024-09-12T02:34:07.346986+0000","last_clean":"2024-09-12T02:34:07.346986+0000","last_became_active":"2024-09-12T02:34:01.056658+0000","last_became_peered":"2024-09-12T02:34:01.056658+0000","last_unstale":"2024-09-12T02:34:07.346986+0000","last_undegraded":"2024-09-12T02:34:07.346986+0000","last_fullsized":"2024-09-12T02:34:07.346986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.216224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.835827+0000","last_change":"2024-09-12T02:34:00.061960+0000","last_active":"2024-09-12T02:34:08.835827+0000","last_peered":"2024-09-12T02:34:08.835827+0000","last_clean":"2024-09-12T02:34:08.835827+0000","last_became_active":"2024-09-12T02:34:00.061710+0000","last_became_peered":"2024-09-12T02:34:00.061710+0000","last_unstale":"2024-09-12T02:34:08.835827+0000","last_undegraded":"2024-09-12T02:34:08.835827+0000","last_fullsized":"2024-09-12T02:34:08.835827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:56.195240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347500+0000","last_change":"2024-09-12T02:34:05.658955+0000","last_active":"2024-09-12T02:34:07.347500+0000","last_peered":"2024-09-12T02:34:07.347500+0000","last_clean":"2024-09-12T02:34:07.347500+0000","last_became_active":"2024-09-12T02:34:05.657958+0000","last_became_peered":"2024-09-12T02:34:05.657958+0000","last_unstale":"2024-09-12T02:34:07.347500+0000","last_undegraded":"2024-09-12T02:34:07.347500+0000","last_fullsized":"2024-09-12T02:34:07.347500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.091046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562253+0000","last_change":"2024-09-12T02:34:01.067308+0000","last_active":"2024-09-12T02:34:08.562253+0000","last_peered":"2024-09-12T02:34:08.562253+0000","last_clean":"2024-09-12T02:34:08.562253+0000","last_became_active":"2024-09-12T02:34:01.066973+0000","last_became_peered":"2024-09-12T02:34:01.066973+0000","last_unstale":"2024-09-12T02:34:08.562253+0000","last_undegraded":"2024-09-12T02:34:08.562253+0000","last_fullsized":"2024-09-12T02:34:08.562253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.656076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895930+0000","last_change":"2024-09-12T02:34:00.055611+0000","last_active":"2024-09-12T02:34:07.895930+0000","last_peered":"2024-09-12T02:34:07.895930+0000","last_clean":"2024-09-12T02:34:07.895930+0000","last_became_active":"2024-09-12T02:34:00.055344+0000","last_became_peered":"2024-09-12T02:34:00.055344+0000","last_unstale":"2024-09-12T02:34:07.895930+0000","last_undegraded":"2024-09-12T02:34:07.895930+0000","last_fullsized":"2024-09-12T02:34:07.895930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836209+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:08.836209+0000","last_peered":"2024-09-12T02:34:08.836209+0000","last_clean":"2024-09-12T02:34:08.836209+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:08.836209+0000","last_undegraded":"2024-09-12T02:34:08.836209+0000","last_fullsized":"2024-09-12T02:34:08.836209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095519+0000","last_change":"2024-09-12T02:34:05.658756+0000","last_active":"2024-09-12T02:34:07.095519+0000","last_peered":"2024-09-12T02:34:07.095519+0000","last_clean":"2024-09-12T02:34:07.095519+0000","last_became_active":"2024-09-12T02:34:05.658203+0000","last_became_peered":"2024-09-12T02:34:05.658203+0000","last_unstale":"2024-09-12T02:34:07.095519+0000","last_undegraded":"2024-09-12T02:34:07.095519+0000","last_fullsized":"2024-09-12T02:34:07.095519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.330679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836636+0000","last_change":"2024-09-12T02:34:01.069608+0000","last_active":"2024-09-12T02:34:08.836636+0000","last_peered":"2024-09-12T02:34:08.836636+0000","last_clean":"2024-09-12T02:34:08.836636+0000","last_became_active":"2024-09-12T02:34:01.069122+0000","last_became_peered":"2024-09-12T02:34:01.069122+0000","last_unstale":"2024-09-12T02:34:08.836636+0000","last_undegraded":"2024-09-12T02:34:08.836636+0000","last_fullsized":"2024-09-12T02:34:08.836636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:31.032652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090639+0000","last_change":"2024-09-12T02:34:00.054247+0000","last_active":"2024-09-12T02:34:07.090639+0000","last_peered":"2024-09-12T02:34:07.090639+0000","last_clean":"2024-09-12T02:34:07.090639+0000","last_became_active":"2024-09-12T02:34:00.053946+0000","last_became_peered":"2024-09-12T02:34:00.053946+0000","last_unstale":"2024-09-12T02:34:07.090639+0000","last_undegraded":"2024-09-12T02:34:07.090639+0000","last_fullsized":"2024-09-12T02:34:07.090639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:07.754916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:05.656456+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:05.656039+0000","last_became_peered":"2024-09-12T02:34:05.656039+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.059721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895983+0000","last_change":"2024-09-12T02:34:01.066544+0000","last_active":"2024-09-12T02:34:07.895983+0000","last_peered":"2024-09-12T02:34:07.895983+0000","last_clean":"2024-09-12T02:34:07.895983+0000","last_became_active":"2024-09-12T02:34:01.065801+0000","last_became_peered":"2024-09-12T02:34:01.065801+0000","last_unstale":"2024-09-12T02:34:07.895983+0000","last_undegraded":"2024-09-12T02:34:07.895983+0000","last_fullsized":"2024-09-12T02:34:07.895983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266060+0000","last_change":"2024-09-12T02:34:00.053363+0000","last_active":"2024-09-12T02:34:07.266060+0000","last_peered":"2024-09-12T02:34:07.266060+0000","last_clean":"2024-09-12T02:34:07.266060+0000","last_became_active":"2024-09-12T02:34:00.053091+0000","last_became_peered":"2024-09-12T02:34:00.053091+0000","last_unstale":"2024-09-12T02:34:07.266060+0000","last_undegraded":"2024-09-12T02:34:07.266060+0000","last_fullsized":"2024-09-12T02:34:07.266060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347382+0000","last_change":"2024-09-12T02:34:05.083388+0000","last_active":"2024-09-12T02:34:07.347382+0000","last_peered":"2024-09-12T02:34:07.347382+0000","last_clean":"2024-09-12T02:34:07.347382+0000","last_became_active":"2024-09-12T02:34:05.082457+0000","last_became_peered":"2024-09-12T02:34:05.082457+0000","last_unstale":"2024-09-12T02:34:07.347382+0000","last_undegraded":"2024-09-12T02:34:07.347382+0000","last_fullsized":"2024-09-12T02:34:07.347382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:00.525145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836912+0000","last_change":"2024-09-12T02:34:01.074931+0000","last_active":"2024-09-12T02:34:08.836912+0000","last_peered":"2024-09-12T02:34:08.836912+0000","last_clean":"2024-09-12T02:34:08.836912+0000","last_became_active":"2024-09-12T02:34:01.074653+0000","last_became_peered":"2024-09-12T02:34:01.074653+0000","last_unstale":"2024-09-12T02:34:08.836912+0000","last_undegraded":"2024-09-12T02:34:08.836912+0000","last_fullsized":"2024-09-12T02:34:08.836912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:43.458949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090480+0000","last_change":"2024-09-12T02:34:00.055519+0000","last_active":"2024-09-12T02:34:07.090480+0000","last_peered":"2024-09-12T02:34:07.090480+0000","last_clean":"2024-09-12T02:34:07.090480+0000","last_became_active":"2024-09-12T02:34:00.055196+0000","last_became_peered":"2024-09-12T02:34:00.055196+0000","last_unstale":"2024-09-12T02:34:07.090480+0000","last_undegraded":"2024-09-12T02:34:07.090480+0000","last_fullsized":"2024-09-12T02:34:07.090480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.742903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895518+0000","last_change":"2024-09-12T02:34:05.658643+0000","last_active":"2024-09-12T02:34:07.895518+0000","last_peered":"2024-09-12T02:34:07.895518+0000","last_clean":"2024-09-12T02:34:07.895518+0000","last_became_active":"2024-09-12T02:34:05.658201+0000","last_became_peered":"2024-09-12T02:34:05.658201+0000","last_unstale":"2024-09-12T02:34:07.895518+0000","last_undegraded":"2024-09-12T02:34:07.895518+0000","last_fullsized":"2024-09-12T02:34:07.895518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.544978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836870+0000","last_change":"2024-09-12T02:34:01.068158+0000","last_active":"2024-09-12T02:34:08.836870+0000","last_peered":"2024-09-12T02:34:08.836870+0000","last_clean":"2024-09-12T02:34:08.836870+0000","last_became_active":"2024-09-12T02:34:01.067814+0000","last_became_peered":"2024-09-12T02:34:01.067814+0000","last_unstale":"2024-09-12T02:34:08.836870+0000","last_undegraded":"2024-09-12T02:34:08.836870+0000","last_fullsized":"2024-09-12T02:34:08.836870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095425+0000","last_change":"2024-09-12T02:34:00.057323+0000","last_active":"2024-09-12T02:34:07.095425+0000","last_peered":"2024-09-12T02:34:07.095425+0000","last_clean":"2024-09-12T02:34:07.095425+0000","last_became_active":"2024-09-12T02:34:00.057029+0000","last_became_peered":"2024-09-12T02:34:00.057029+0000","last_unstale":"2024-09-12T02:34:07.095425+0000","last_undegraded":"2024-09-12T02:34:07.095425+0000","last_fullsized":"2024-09-12T02:34:07.095425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:59.639173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094272+0000","last_change":"2024-09-12T02:34:05.079794+0000","last_active":"2024-09-12T02:34:07.094272+0000","last_peered":"2024-09-12T02:34:07.094272+0000","last_clean":"2024-09-12T02:34:07.094272+0000","last_became_active":"2024-09-12T02:34:05.079405+0000","last_became_peered":"2024-09-12T02:34:05.079405+0000","last_unstale":"2024-09-12T02:34:07.094272+0000","last_undegraded":"2024-09-12T02:34:07.094272+0000","last_fullsized":"2024-09-12T02:34:07.094272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836441+0000","last_change":"2024-09-12T02:34:01.057423+0000","last_active":"2024-09-12T02:34:08.836441+0000","last_peered":"2024-09-12T02:34:08.836441+0000","last_clean":"2024-09-12T02:34:08.836441+0000","last_became_active":"2024-09-12T02:34:01.057128+0000","last_became_peered":"2024-09-12T02:34:01.057128+0000","last_unstale":"2024-09-12T02:34:08.836441+0000","last_undegraded":"2024-09-12T02:34:08.836441+0000","last_fullsized":"2024-09-12T02:34:08.836441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:38.366821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090168+0000","last_change":"2024-09-12T02:34:00.048532+0000","last_active":"2024-09-12T02:34:07.090168+0000","last_peered":"2024-09-12T02:34:07.090168+0000","last_clean":"2024-09-12T02:34:07.090168+0000","last_became_active":"2024-09-12T02:34:00.048245+0000","last_became_peered":"2024-09-12T02:34:00.048245+0000","last_unstale":"2024-09-12T02:34:07.090168+0000","last_undegraded":"2024-09-12T02:34:07.090168+0000","last_fullsized":"2024-09-12T02:34:07.090168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:23.482609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347436+0000","last_change":"2024-09-12T02:34:05.079264+0000","last_active":"2024-09-12T02:34:07.347436+0000","last_peered":"2024-09-12T02:34:07.347436+0000","last_clean":"2024-09-12T02:34:07.347436+0000","last_became_active":"2024-09-12T02:34:05.078754+0000","last_became_peered":"2024-09-12T02:34:05.078754+0000","last_unstale":"2024-09-12T02:34:07.347436+0000","last_undegraded":"2024-09-12T02:34:07.347436+0000","last_fullsized":"2024-09-12T02:34:07.347436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:31.971564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094120+0000","last_change":"2024-09-12T02:34:01.060623+0000","last_active":"2024-09-12T02:34:07.094120+0000","last_peered":"2024-09-12T02:34:07.094120+0000","last_clean":"2024-09-12T02:34:07.094120+0000","last_became_active":"2024-09-12T02:34:01.060339+0000","last_became_peered":"2024-09-12T02:34:01.060339+0000","last_unstale":"2024-09-12T02:34:07.094120+0000","last_undegraded":"2024-09-12T02:34:07.094120+0000","last_fullsized":"2024-09-12T02:34:07.094120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094569+0000","last_change":"2024-09-12T02:34:00.051189+0000","last_active":"2024-09-12T02:34:07.094569+0000","last_peered":"2024-09-12T02:34:07.094569+0000","last_clean":"2024-09-12T02:34:07.094569+0000","last_became_active":"2024-09-12T02:34:00.050920+0000","last_became_peered":"2024-09-12T02:34:00.050920+0000","last_unstale":"2024-09-12T02:34:07.094569+0000","last_undegraded":"2024-09-12T02:34:07.094569+0000","last_fullsized":"2024-09-12T02:34:07.094569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562819+0000","last_change":"2024-09-12T02:34:05.658569+0000","last_active":"2024-09-12T02:34:08.562819+0000","last_peered":"2024-09-12T02:34:08.562819+0000","last_clean":"2024-09-12T02:34:08.562819+0000","last_became_active":"2024-09-12T02:34:05.658174+0000","last_became_peered":"2024-09-12T02:34:05.658174+0000","last_unstale":"2024-09-12T02:34:08.562819+0000","last_undegraded":"2024-09-12T02:34:08.562819+0000","last_fullsized":"2024-09-12T02:34:08.562819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:28.956735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836570+0000","last_change":"2024-09-12T02:34:01.065005+0000","last_active":"2024-09-12T02:34:08.836570+0000","last_peered":"2024-09-12T02:34:08.836570+0000","last_clean":"2024-09-12T02:34:08.836570+0000","last_became_active":"2024-09-12T02:34:01.064722+0000","last_became_peered":"2024-09-12T02:34:01.064722+0000","last_unstale":"2024-09-12T02:34:08.836570+0000","last_undegraded":"2024-09-12T02:34:08.836570+0000","last_fullsized":"2024-09-12T02:34:08.836570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.425590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895958+0000","last_change":"2024-09-12T02:34:00.058485+0000","last_active":"2024-09-12T02:34:07.895958+0000","last_peered":"2024-09-12T02:34:07.895958+0000","last_clean":"2024-09-12T02:34:07.895958+0000","last_became_active":"2024-09-12T02:34:00.058013+0000","last_became_peered":"2024-09-12T02:34:00.058013+0000","last_unstale":"2024-09-12T02:34:07.895958+0000","last_undegraded":"2024-09-12T02:34:07.895958+0000","last_fullsized":"2024-09-12T02:34:07.895958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:05.961222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562509+0000","last_change":"2024-09-12T02:34:05.659437+0000","last_active":"2024-09-12T02:34:08.562509+0000","last_peered":"2024-09-12T02:34:08.562509+0000","last_clean":"2024-09-12T02:34:08.562509+0000","last_became_active":"2024-09-12T02:34:05.658091+0000","last_became_peered":"2024-09-12T02:34:05.658091+0000","last_unstale":"2024-09-12T02:34:08.562509+0000","last_undegraded":"2024-09-12T02:34:08.562509+0000","last_fullsized":"2024-09-12T02:34:08.562509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:49.468958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347237+0000","last_change":"2024-09-12T02:34:01.058834+0000","last_active":"2024-09-12T02:34:07.347237+0000","last_peered":"2024-09-12T02:34:07.347237+0000","last_clean":"2024-09-12T02:34:07.347237+0000","last_became_active":"2024-09-12T02:34:01.058557+0000","last_became_peered":"2024-09-12T02:34:01.058557+0000","last_unstale":"2024-09-12T02:34:07.347237+0000","last_undegraded":"2024-09-12T02:34:07.347237+0000","last_fullsized":"2024-09-12T02:34:07.347237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347544+0000","last_change":"2024-09-12T02:34:00.057001+0000","last_active":"2024-09-12T02:34:07.347544+0000","last_peered":"2024-09-12T02:34:07.347544+0000","last_clean":"2024-09-12T02:34:07.347544+0000","last_became_active":"2024-09-12T02:34:00.056685+0000","last_became_peered":"2024-09-12T02:34:00.056685+0000","last_unstale":"2024-09-12T02:34:07.347544+0000","last_undegraded":"2024-09-12T02:34:07.347544+0000","last_fullsized":"2024-09-12T02:34:07.347544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.793722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896082+0000","last_change":"2024-09-12T02:34:05.660619+0000","last_active":"2024-09-12T02:34:07.896082+0000","last_peered":"2024-09-12T02:34:07.896082+0000","last_clean":"2024-09-12T02:34:07.896082+0000","last_became_active":"2024-09-12T02:34:05.659790+0000","last_became_peered":"2024-09-12T02:34:05.659790+0000","last_unstale":"2024-09-12T02:34:07.896082+0000","last_undegraded":"2024-09-12T02:34:07.896082+0000","last_fullsized":"2024-09-12T02:34:07.896082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:38.472945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836579+0000","last_change":"2024-09-12T02:34:01.069392+0000","last_active":"2024-09-12T02:34:08.836579+0000","last_peered":"2024-09-12T02:34:08.836579+0000","last_clean":"2024-09-12T02:34:08.836579+0000","last_became_active":"2024-09-12T02:34:01.069065+0000","last_became_peered":"2024-09-12T02:34:01.069065+0000","last_unstale":"2024-09-12T02:34:08.836579+0000","last_undegraded":"2024-09-12T02:34:08.836579+0000","last_fullsized":"2024-09-12T02:34:08.836579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:10.464560+0000","last_change":"2024-09-12T02:34:00.058230+0000","last_active":"2024-09-12T02:34:10.464560+0000","last_peered":"2024-09-12T02:34:10.464560+0000","last_clean":"2024-09-12T02:34:10.464560+0000","last_became_active":"2024-09-12T02:34:00.057965+0000","last_became_peered":"2024-09-12T02:34:00.057965+0000","last_unstale":"2024-09-12T02:34:10.464560+0000","last_undegraded":"2024-09-12T02:34:10.464560+0000","last_fullsized":"2024-09-12T02:34:10.464560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.826468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265696+0000","last_change":"2024-09-12T02:34:05.084205+0000","last_active":"2024-09-12T02:34:07.265696+0000","last_peered":"2024-09-12T02:34:07.265696+0000","last_clean":"2024-09-12T02:34:07.265696+0000","last_became_active":"2024-09-12T02:34:05.083830+0000","last_became_peered":"2024-09-12T02:34:05.083830+0000","last_unstale":"2024-09-12T02:34:07.265696+0000","last_undegraded":"2024-09-12T02:34:07.265696+0000","last_fullsized":"2024-09-12T02:34:07.265696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095341+0000","last_change":"2024-09-12T02:34:01.059209+0000","last_active":"2024-09-12T02:34:07.095341+0000","last_peered":"2024-09-12T02:34:07.095341+0000","last_clean":"2024-09-12T02:34:07.095341+0000","last_became_active":"2024-09-12T02:34:01.058918+0000","last_became_peered":"2024-09-12T02:34:01.058918+0000","last_unstale":"2024-09-12T02:34:07.095341+0000","last_undegraded":"2024-09-12T02:34:07.095341+0000","last_fullsized":"2024-09-12T02:34:07.095341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.313534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266057+0000","last_change":"2024-09-12T02:34:00.054000+0000","last_active":"2024-09-12T02:34:07.266057+0000","last_peered":"2024-09-12T02:34:07.266057+0000","last_clean":"2024-09-12T02:34:07.266057+0000","last_became_active":"2024-09-12T02:34:00.053740+0000","last_became_peered":"2024-09-12T02:34:00.053740+0000","last_unstale":"2024-09-12T02:34:07.266057+0000","last_undegraded":"2024-09-12T02:34:07.266057+0000","last_fullsized":"2024-09-12T02:34:07.266057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094290+0000","last_change":"2024-09-12T02:34:05.076783+0000","last_active":"2024-09-12T02:34:07.094290+0000","last_peered":"2024-09-12T02:34:07.094290+0000","last_clean":"2024-09-12T02:34:07.094290+0000","last_became_active":"2024-09-12T02:34:05.076363+0000","last_became_peered":"2024-09-12T02:34:05.076363+0000","last_unstale":"2024-09-12T02:34:07.094290+0000","last_undegraded":"2024-09-12T02:34:07.094290+0000","last_fullsized":"2024-09-12T02:34:07.094290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:25.870250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347370+0000","last_change":"2024-09-12T02:34:01.066781+0000","last_active":"2024-09-12T02:34:07.347370+0000","last_peered":"2024-09-12T02:34:07.347370+0000","last_clean":"2024-09-12T02:34:07.347370+0000","last_became_active":"2024-09-12T02:34:01.066488+0000","last_became_peered":"2024-09-12T02:34:01.066488+0000","last_unstale":"2024-09-12T02:34:07.347370+0000","last_undegraded":"2024-09-12T02:34:07.347370+0000","last_fullsized":"2024-09-12T02:34:07.347370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896103+0000","last_change":"2024-09-12T02:34:00.053362+0000","last_active":"2024-09-12T02:34:07.896103+0000","last_peered":"2024-09-12T02:34:07.896103+0000","last_clean":"2024-09-12T02:34:07.896103+0000","last_became_active":"2024-09-12T02:34:00.053065+0000","last_became_peered":"2024-09-12T02:34:00.053065+0000","last_unstale":"2024-09-12T02:34:07.896103+0000","last_undegraded":"2024-09-12T02:34:07.896103+0000","last_fullsized":"2024-09-12T02:34:07.896103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562161+0000","last_change":"2024-09-12T02:34:05.078084+0000","last_active":"2024-09-12T02:34:08.562161+0000","last_peered":"2024-09-12T02:34:08.562161+0000","last_clean":"2024-09-12T02:34:08.562161+0000","last_became_active":"2024-09-12T02:34:05.077651+0000","last_became_peered":"2024-09-12T02:34:05.077651+0000","last_unstale":"2024-09-12T02:34:08.562161+0000","last_undegraded":"2024-09-12T02:34:08.562161+0000","last_fullsized":"2024-09-12T02:34:08.562161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:12.453888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896027+0000","last_change":"2024-09-12T02:34:01.069626+0000","last_active":"2024-09-12T02:34:07.896027+0000","last_peered":"2024-09-12T02:34:07.896027+0000","last_clean":"2024-09-12T02:34:07.896027+0000","last_became_active":"2024-09-12T02:34:01.069377+0000","last_became_peered":"2024-09-12T02:34:01.069377+0000","last_unstale":"2024-09-12T02:34:07.896027+0000","last_undegraded":"2024-09-12T02:34:07.896027+0000","last_fullsized":"2024-09-12T02:34:07.896027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:00.054287+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:00.054015+0000","last_became_peered":"2024-09-12T02:34:00.054015+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:20.821216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562172+0000","last_change":"2024-09-12T02:34:05.662260+0000","last_active":"2024-09-12T02:34:08.562172+0000","last_peered":"2024-09-12T02:34:08.562172+0000","last_clean":"2024-09-12T02:34:08.562172+0000","last_became_active":"2024-09-12T02:34:05.662024+0000","last_became_peered":"2024-09-12T02:34:05.662024+0000","last_unstale":"2024-09-12T02:34:08.562172+0000","last_undegraded":"2024-09-12T02:34:08.562172+0000","last_fullsized":"2024-09-12T02:34:08.562172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:58.165661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347329+0000","last_change":"2024-09-12T02:34:05.659237+0000","last_active":"2024-09-12T02:34:07.347329+0000","last_peered":"2024-09-12T02:34:07.347329+0000","last_clean":"2024-09-12T02:34:07.347329+0000","last_became_active":"2024-09-12T02:34:05.658549+0000","last_became_peered":"2024-09-12T02:34:05.658549+0000","last_unstale":"2024-09-12T02:34:07.347329+0000","last_undegraded":"2024-09-12T02:34:07.347329+0000","last_fullsized":"2024-09-12T02:34:07.347329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:32.807417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265465+0000","last_change":"2024-09-12T02:34:01.053018+0000","last_active":"2024-09-12T02:34:07.265465+0000","last_peered":"2024-09-12T02:34:07.265465+0000","last_clean":"2024-09-12T02:34:07.265465+0000","last_became_active":"2024-09-12T02:34:01.052640+0000","last_became_peered":"2024-09-12T02:34:01.052640+0000","last_unstale":"2024-09-12T02:34:07.265465+0000","last_undegraded":"2024-09-12T02:34:07.265465+0000","last_fullsized":"2024-09-12T02:34:07.265465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895717+0000","last_change":"2024-09-12T02:34:00.059071+0000","last_active":"2024-09-12T02:34:07.895717+0000","last_peered":"2024-09-12T02:34:07.895717+0000","last_clean":"2024-09-12T02:34:07.895717+0000","last_became_active":"2024-09-12T02:34:00.058712+0000","last_became_peered":"2024-09-12T02:34:00.058712+0000","last_unstale":"2024-09-12T02:34:07.895717+0000","last_undegraded":"2024-09-12T02:34:07.895717+0000","last_fullsized":"2024-09-12T02:34:07.895717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:12.063182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095271+0000","last_change":"2024-09-12T02:34:05.078933+0000","last_active":"2024-09-12T02:34:07.095271+0000","last_peered":"2024-09-12T02:34:07.095271+0000","last_clean":"2024-09-12T02:34:07.095271+0000","last_became_active":"2024-09-12T02:34:05.078471+0000","last_became_peered":"2024-09-12T02:34:05.078471+0000","last_unstale":"2024-09-12T02:34:07.095271+0000","last_undegraded":"2024-09-12T02:34:07.095271+0000","last_fullsized":"2024-09-12T02:34:07.095271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:55.067817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562145+0000","last_change":"2024-09-12T02:34:01.062159+0000","last_active":"2024-09-12T02:34:08.562145+0000","last_peered":"2024-09-12T02:34:08.562145+0000","last_clean":"2024-09-12T02:34:08.562145+0000","last_became_active":"2024-09-12T02:34:01.061853+0000","last_became_peered":"2024-09-12T02:34:01.061853+0000","last_unstale":"2024-09-12T02:34:08.562145+0000","last_undegraded":"2024-09-12T02:34:08.562145+0000","last_fullsized":"2024-09-12T02:34:08.562145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:30.820938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.561699+0000","last_change":"2024-09-12T02:34:00.059938+0000","last_active":"2024-09-12T02:34:08.561699+0000","last_peered":"2024-09-12T02:34:08.561699+0000","last_clean":"2024-09-12T02:34:08.561699+0000","last_became_active":"2024-09-12T02:34:00.059625+0000","last_became_peered":"2024-09-12T02:34:00.059625+0000","last_unstale":"2024-09-12T02:34:08.561699+0000","last_undegraded":"2024-09-12T02:34:08.561699+0000","last_fullsized":"2024-09-12T02:34:08.561699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:40.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094779+0000","last_change":"2024-09-12T02:34:00.048853+0000","last_active":"2024-09-12T02:34:07.094779+0000","last_peered":"2024-09-12T02:34:07.094779+0000","last_clean":"2024-09-12T02:34:07.094779+0000","last_became_active":"2024-09-12T02:34:00.048563+0000","last_became_peered":"2024-09-12T02:34:00.048563+0000","last_unstale":"2024-09-12T02:34:07.094779+0000","last_undegraded":"2024-09-12T02:34:07.094779+0000","last_fullsized":"2024-09-12T02:34:07.094779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.179354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.056880+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.056573+0000","last_became_peered":"2024-09-12T02:34:01.056573+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090610+0000","last_change":"2024-09-12T02:34:05.079707+0000","last_active":"2024-09-12T02:34:07.090610+0000","last_peered":"2024-09-12T02:34:07.090610+0000","last_clean":"2024-09-12T02:34:07.090610+0000","last_became_active":"2024-09-12T02:34:05.079349+0000","last_became_peered":"2024-09-12T02:34:05.079349+0000","last_unstale":"2024-09-12T02:34:07.090610+0000","last_undegraded":"2024-09-12T02:34:07.090610+0000","last_fullsized":"2024-09-12T02:34:07.090610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:17.011167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562431+0000","last_change":"2024-09-12T02:34:00.057281+0000","last_active":"2024-09-12T02:34:08.562431+0000","last_peered":"2024-09-12T02:34:08.562431+0000","last_clean":"2024-09-12T02:34:08.562431+0000","last_became_active":"2024-09-12T02:34:00.057004+0000","last_became_peered":"2024-09-12T02:34:00.057004+0000","last_unstale":"2024-09-12T02:34:08.562431+0000","last_undegraded":"2024-09-12T02:34:08.562431+0000","last_fullsized":"2024-09-12T02:34:08.562431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:59.024035+0000","last_clean_scrub_stamp":"2024-09-12T02:33:59.024035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:23.045646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094064+0000","last_change":"2024-09-12T02:34:01.056167+0000","last_active":"2024-09-12T02:34:07.094064+0000","last_peered":"2024-09-12T02:34:07.094064+0000","last_clean":"2024-09-12T02:34:07.094064+0000","last_became_active":"2024-09-12T02:34:01.055914+0000","last_became_peered":"2024-09-12T02:34:01.055914+0000","last_unstale":"2024-09-12T02:34:07.094064+0000","last_undegraded":"2024-09-12T02:34:07.094064+0000","last_fullsized":"2024-09-12T02:34:07.094064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:06.967072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562579+0000","last_change":"2024-09-12T02:34:05.078328+0000","last_active":"2024-09-12T02:34:08.562579+0000","last_peered":"2024-09-12T02:34:08.562579+0000","last_clean":"2024-09-12T02:34:08.562579+0000","last_became_active":"2024-09-12T02:34:05.077613+0000","last_became_peered":"2024-09-12T02:34:05.077613+0000","last_unstale":"2024-09-12T02:34:08.562579+0000","last_undegraded":"2024-09-12T02:34:08.562579+0000","last_fullsized":"2024-09-12T02:34:08.562579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:04.056953+0000","last_clean_scrub_stamp":"2024-09-12T02:34:04.056953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.567364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.093915+0000","last_change":"2024-09-12T02:34:01.061088+0000","last_active":"2024-09-12T02:34:07.093915+0000","last_peered":"2024-09-12T02:34:07.093915+0000","last_clean":"2024-09-12T02:34:07.093915+0000","last_became_active":"2024-09-12T02:34:01.060388+0000","last_became_peered":"2024-09-12T02:34:01.060388+0000","last_unstale":"2024-09-12T02:34:07.093915+0000","last_undegraded":"2024-09-12T02:34:07.093915+0000","last_fullsized":"2024-09-12T02:34:07.093915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.596246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090261+0000","last_change":"2024-09-12T02:34:01.057775+0000","last_active":"2024-09-12T02:34:07.090261+0000","last_peered":"2024-09-12T02:34:07.090261+0000","last_clean":"2024-09-12T02:34:07.090261+0000","last_became_active":"2024-09-12T02:34:01.057444+0000","last_became_peered":"2024-09-12T02:34:01.057444+0000","last_unstale":"2024-09-12T02:34:07.090261+0000","last_undegraded":"2024-09-12T02:34:07.090261+0000","last_fullsized":"2024-09-12T02:34:07.090261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:59.156424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895959+0000","last_change":"2024-09-12T02:34:01.064983+0000","last_active":"2024-09-12T02:34:07.895959+0000","last_peered":"2024-09-12T02:34:07.895959+0000","last_clean":"2024-09-12T02:34:07.895959+0000","last_became_active":"2024-09-12T02:34:01.064526+0000","last_became_peered":"2024-09-12T02:34:01.064526+0000","last_unstale":"2024-09-12T02:34:07.895959+0000","last_undegraded":"2024-09-12T02:34:07.895959+0000","last_fullsized":"2024-09-12T02:34:07.895959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.533943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347478+0000","last_change":"2024-09-12T02:34:01.055170+0000","last_active":"2024-09-12T02:34:07.347478+0000","last_peered":"2024-09-12T02:34:07.347478+0000","last_clean":"2024-09-12T02:34:07.347478+0000","last_became_active":"2024-09-12T02:34:01.054896+0000","last_became_peered":"2024-09-12T02:34:01.054896+0000","last_unstale":"2024-09-12T02:34:07.347478+0000","last_undegraded":"2024-09-12T02:34:07.347478+0000","last_fullsized":"2024-09-12T02:34:07.347478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562609+0000","last_change":"2024-09-12T02:34:01.058376+0000","last_active":"2024-09-12T02:34:08.562609+0000","last_peered":"2024-09-12T02:34:08.562609+0000","last_clean":"2024-09-12T02:34:08.562609+0000","last_became_active":"2024-09-12T02:34:01.058094+0000","last_became_peered":"2024-09-12T02:34:01.058094+0000","last_unstale":"2024-09-12T02:34:08.562609+0000","last_undegraded":"2024-09-12T02:34:08.562609+0000","last_fullsized":"2024-09-12T02:34:08.562609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:23.542579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265957+0000","last_change":"2024-09-12T02:34:01.049857+0000","last_active":"2024-09-12T02:34:07.265957+0000","last_peered":"2024-09-12T02:34:07.265957+0000","last_clean":"2024-09-12T02:34:07.265957+0000","last_became_active":"2024-09-12T02:34:01.049533+0000","last_became_peered":"2024-09-12T02:34:01.049533+0000","last_unstale":"2024-09-12T02:34:07.265957+0000","last_undegraded":"2024-09-12T02:34:07.265957+0000","last_fullsized":"2024-09-12T02:34:07.265957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095094+0000","last_change":"2024-09-12T02:34:01.059501+0000","last_active":"2024-09-12T02:34:07.095094+0000","last_peered":"2024-09-12T02:34:07.095094+0000","last_clean":"2024-09-12T02:34:07.095094+0000","last_became_active":"2024-09-12T02:34:01.059225+0000","last_became_peered":"2024-09-12T02:34:01.059225+0000","last_unstale":"2024-09-12T02:34:07.095094+0000","last_undegraded":"2024-09-12T02:34:07.095094+0000","last_fullsized":"2024-09-12T02:34:07.095094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562804+0000","last_change":"2024-09-12T02:34:01.055984+0000","last_active":"2024-09-12T02:34:08.562804+0000","last_peered":"2024-09-12T02:34:08.562804+0000","last_clean":"2024-09-12T02:34:08.562804+0000","last_became_active":"2024-09-12T02:34:01.055717+0000","last_became_peered":"2024-09-12T02:34:01.055717+0000","last_unstale":"2024-09-12T02:34:08.562804+0000","last_undegraded":"2024-09-12T02:34:08.562804+0000","last_fullsized":"2024-09-12T02:34:08.562804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895650+0000","last_change":"2024-09-12T02:34:01.065533+0000","last_active":"2024-09-12T02:34:07.895650+0000","last_peered":"2024-09-12T02:34:07.895650+0000","last_clean":"2024-09-12T02:34:07.895650+0000","last_became_active":"2024-09-12T02:34:01.065247+0000","last_became_peered":"2024-09-12T02:34:01.065247+0000","last_unstale":"2024-09-12T02:34:07.895650+0000","last_undegraded":"2024-09-12T02:34:07.895650+0000","last_fullsized":"2024-09-12T02:34:07.895650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:40.545417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562279+0000","last_change":"2024-09-12T02:34:01.056565+0000","last_active":"2024-09-12T02:34:08.562279+0000","last_peered":"2024-09-12T02:34:08.562279+0000","last_clean":"2024-09-12T02:34:08.562279+0000","last_became_active":"2024-09-12T02:34:01.056227+0000","last_became_peered":"2024-09-12T02:34:01.056227+0000","last_unstale":"2024-09-12T02:34:08.562279+0000","last_undegraded":"2024-09-12T02:34:08.562279+0000","last_fullsized":"2024-09-12T02:34:08.562279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:47.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895752+0000","last_change":"2024-09-12T02:34:01.070313+0000","last_active":"2024-09-12T02:34:07.895752+0000","last_peered":"2024-09-12T02:34:07.895752+0000","last_clean":"2024-09-12T02:34:07.895752+0000","last_became_active":"2024-09-12T02:34:01.070031+0000","last_became_peered":"2024-09-12T02:34:01.070031+0000","last_unstale":"2024-09-12T02:34:07.895752+0000","last_undegraded":"2024-09-12T02:34:07.895752+0000","last_fullsized":"2024-09-12T02:34:07.895752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:59.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347244+0000","last_change":"2024-09-12T02:34:01.060012+0000","last_active":"2024-09-12T02:34:07.347244+0000","last_peered":"2024-09-12T02:34:07.347244+0000","last_clean":"2024-09-12T02:34:07.347244+0000","last_became_active":"2024-09-12T02:34:01.059756+0000","last_became_peered":"2024-09-12T02:34:01.059756+0000","last_unstale":"2024-09-12T02:34:07.347244+0000","last_undegraded":"2024-09-12T02:34:07.347244+0000","last_fullsized":"2024-09-12T02:34:07.347244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.654168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094908+0000","last_change":"2024-09-12T02:34:01.056798+0000","last_active":"2024-09-12T02:34:07.094908+0000","last_peered":"2024-09-12T02:34:07.094908+0000","last_clean":"2024-09-12T02:34:07.094908+0000","last_became_active":"2024-09-12T02:34:01.056523+0000","last_became_peered":"2024-09-12T02:34:01.056523+0000","last_unstale":"2024-09-12T02:34:07.094908+0000","last_undegraded":"2024-09-12T02:34:07.094908+0000","last_fullsized":"2024-09-12T02:34:07.094908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:56.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836766+0000","last_change":"2024-09-12T02:34:01.069679+0000","last_active":"2024-09-12T02:34:08.836766+0000","last_peered":"2024-09-12T02:34:08.836766+0000","last_clean":"2024-09-12T02:34:08.836766+0000","last_became_active":"2024-09-12T02:34:01.069397+0000","last_became_peered":"2024-09-12T02:34:01.069397+0000","last_unstale":"2024-09-12T02:34:08.836766+0000","last_undegraded":"2024-09-12T02:34:08.836766+0000","last_fullsized":"2024-09-12T02:34:08.836766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:08.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.090422+0000","last_change":"2024-09-12T02:34:01.054994+0000","last_active":"2024-09-12T02:34:07.090422+0000","last_peered":"2024-09-12T02:34:07.090422+0000","last_clean":"2024-09-12T02:34:07.090422+0000","last_became_active":"2024-09-12T02:34:01.054724+0000","last_became_peered":"2024-09-12T02:34:01.054724+0000","last_unstale":"2024-09-12T02:34:07.090422+0000","last_undegraded":"2024-09-12T02:34:07.090422+0000","last_fullsized":"2024-09-12T02:34:07.090422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:34.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.896338+0000","last_change":"2024-09-12T02:34:01.076336+0000","last_active":"2024-09-12T02:34:07.896338+0000","last_peered":"2024-09-12T02:34:07.896338+0000","last_clean":"2024-09-12T02:34:07.896338+0000","last_became_active":"2024-09-12T02:34:01.075961+0000","last_became_peered":"2024-09-12T02:34:01.075961+0000","last_unstale":"2024-09-12T02:34:07.896338+0000","last_undegraded":"2024-09-12T02:34:07.896338+0000","last_fullsized":"2024-09-12T02:34:07.896338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:15.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895531+0000","last_change":"2024-09-12T02:34:01.067021+0000","last_active":"2024-09-12T02:34:07.895531+0000","last_peered":"2024-09-12T02:34:07.895531+0000","last_clean":"2024-09-12T02:34:07.895531+0000","last_became_active":"2024-09-12T02:34:01.065834+0000","last_became_peered":"2024-09-12T02:34:01.065834+0000","last_unstale":"2024-09-12T02:34:07.895531+0000","last_undegraded":"2024-09-12T02:34:07.895531+0000","last_fullsized":"2024-09-12T02:34:07.895531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.265540+0000","last_change":"2024-09-12T02:34:01.052768+0000","last_active":"2024-09-12T02:34:07.265540+0000","last_peered":"2024-09-12T02:34:07.265540+0000","last_clean":"2024-09-12T02:34:07.265540+0000","last_became_active":"2024-09-12T02:34:01.052482+0000","last_became_peered":"2024-09-12T02:34:01.052482+0000","last_unstale":"2024-09-12T02:34:07.265540+0000","last_undegraded":"2024-09-12T02:34:07.265540+0000","last_fullsized":"2024-09-12T02:34:07.265540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:53.571950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347203+0000","last_change":"2024-09-12T02:34:01.055910+0000","last_active":"2024-09-12T02:34:07.347203+0000","last_peered":"2024-09-12T02:34:07.347203+0000","last_clean":"2024-09-12T02:34:07.347203+0000","last_became_active":"2024-09-12T02:34:01.055652+0000","last_became_peered":"2024-09-12T02:34:01.055652+0000","last_unstale":"2024-09-12T02:34:07.347203+0000","last_undegraded":"2024-09-12T02:34:07.347203+0000","last_fullsized":"2024-09-12T02:34:07.347203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:30.649532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562369+0000","last_change":"2024-09-12T02:34:01.061023+0000","last_active":"2024-09-12T02:34:08.562369+0000","last_peered":"2024-09-12T02:34:08.562369+0000","last_clean":"2024-09-12T02:34:08.562369+0000","last_became_active":"2024-09-12T02:34:01.060672+0000","last_became_peered":"2024-09-12T02:34:01.060672+0000","last_unstale":"2024-09-12T02:34:08.562369+0000","last_undegraded":"2024-09-12T02:34:08.562369+0000","last_fullsized":"2024-09-12T02:34:08.562369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.491024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095250+0000","last_change":"2024-09-12T02:34:01.061215+0000","last_active":"2024-09-12T02:34:07.095250+0000","last_peered":"2024-09-12T02:34:07.095250+0000","last_clean":"2024-09-12T02:34:07.095250+0000","last_became_active":"2024-09-12T02:34:01.060951+0000","last_became_peered":"2024-09-12T02:34:01.060951+0000","last_unstale":"2024-09-12T02:34:07.095250+0000","last_undegraded":"2024-09-12T02:34:07.095250+0000","last_fullsized":"2024-09-12T02:34:07.095250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:13.069032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.095546+0000","last_change":"2024-09-12T02:34:01.070066+0000","last_active":"2024-09-12T02:34:07.095546+0000","last_peered":"2024-09-12T02:34:07.095546+0000","last_clean":"2024-09-12T02:34:07.095546+0000","last_became_active":"2024-09-12T02:34:01.069783+0000","last_became_peered":"2024-09-12T02:34:01.069783+0000","last_unstale":"2024-09-12T02:34:07.095546+0000","last_undegraded":"2024-09-12T02:34:07.095546+0000","last_fullsized":"2024-09-12T02:34:07.095546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.969512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.094984+0000","last_change":"2024-09-12T02:34:01.070083+0000","last_active":"2024-09-12T02:34:07.094984+0000","last_peered":"2024-09-12T02:34:07.094984+0000","last_clean":"2024-09-12T02:34:07.094984+0000","last_became_active":"2024-09-12T02:34:01.069808+0000","last_became_peered":"2024-09-12T02:34:01.069808+0000","last_unstale":"2024-09-12T02:34:07.094984+0000","last_undegraded":"2024-09-12T02:34:07.094984+0000","last_fullsized":"2024-09-12T02:34:07.094984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:07.373447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836872+0000","last_change":"2024-09-12T02:34:01.074865+0000","last_active":"2024-09-12T02:34:08.836872+0000","last_peered":"2024-09-12T02:34:08.836872+0000","last_clean":"2024-09-12T02:34:08.836872+0000","last_became_active":"2024-09-12T02:34:01.074473+0000","last_became_peered":"2024-09-12T02:34:01.074473+0000","last_unstale":"2024-09-12T02:34:08.836872+0000","last_undegraded":"2024-09-12T02:34:08.836872+0000","last_fullsized":"2024-09-12T02:34:08.836872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:21.843182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.562043+0000","last_change":"2024-09-12T02:34:01.067367+0000","last_active":"2024-09-12T02:34:08.562043+0000","last_peered":"2024-09-12T02:34:08.562043+0000","last_clean":"2024-09-12T02:34:08.562043+0000","last_became_active":"2024-09-12T02:34:01.067024+0000","last_became_peered":"2024-09-12T02:34:01.067024+0000","last_unstale":"2024-09-12T02:34:08.562043+0000","last_undegraded":"2024-09-12T02:34:08.562043+0000","last_fullsized":"2024-09-12T02:34:08.562043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:56.143361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836303+0000","last_change":"2024-09-12T02:34:01.058244+0000","last_active":"2024-09-12T02:34:08.836303+0000","last_peered":"2024-09-12T02:34:08.836303+0000","last_clean":"2024-09-12T02:34:08.836303+0000","last_became_active":"2024-09-12T02:34:01.057968+0000","last_became_peered":"2024-09-12T02:34:01.057968+0000","last_unstale":"2024-09-12T02:34:08.836303+0000","last_undegraded":"2024-09-12T02:34:08.836303+0000","last_fullsized":"2024-09-12T02:34:08.836303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895748+0000","last_change":"2024-09-12T02:34:01.067464+0000","last_active":"2024-09-12T02:34:07.895748+0000","last_peered":"2024-09-12T02:34:07.895748+0000","last_clean":"2024-09-12T02:34:07.895748+0000","last_became_active":"2024-09-12T02:34:01.065862+0000","last_became_peered":"2024-09-12T02:34:01.065862+0000","last_unstale":"2024-09-12T02:34:07.895748+0000","last_undegraded":"2024-09-12T02:34:07.895748+0000","last_fullsized":"2024-09-12T02:34:07.895748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836442+0000","last_change":"2024-09-12T02:34:01.068831+0000","last_active":"2024-09-12T02:34:08.836442+0000","last_peered":"2024-09-12T02:34:08.836442+0000","last_clean":"2024-09-12T02:34:08.836442+0000","last_became_active":"2024-09-12T02:34:01.066724+0000","last_became_peered":"2024-09-12T02:34:01.066724+0000","last_unstale":"2024-09-12T02:34:08.836442+0000","last_undegraded":"2024-09-12T02:34:08.836442+0000","last_fullsized":"2024-09-12T02:34:08.836442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.062720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.895852+0000","last_change":"2024-09-12T02:34:01.065590+0000","last_active":"2024-09-12T02:34:07.895852+0000","last_peered":"2024-09-12T02:34:07.895852+0000","last_clean":"2024-09-12T02:34:07.895852+0000","last_became_active":"2024-09-12T02:34:01.065308+0000","last_became_peered":"2024-09-12T02:34:01.065308+0000","last_unstale":"2024-09-12T02:34:07.895852+0000","last_undegraded":"2024-09-12T02:34:07.895852+0000","last_fullsized":"2024-09-12T02:34:07.895852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:10.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.347223+0000","last_change":"2024-09-12T02:34:01.056168+0000","last_active":"2024-09-12T02:34:07.347223+0000","last_peered":"2024-09-12T02:34:07.347223+0000","last_clean":"2024-09-12T02:34:07.347223+0000","last_became_active":"2024-09-12T02:34:01.055731+0000","last_became_peered":"2024-09-12T02:34:01.055731+0000","last_unstale":"2024-09-12T02:34:07.347223+0000","last_undegraded":"2024-09-12T02:34:07.347223+0000","last_fullsized":"2024-09-12T02:34:07.347223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:07.266139+0000","last_change":"2024-09-12T02:34:01.060961+0000","last_active":"2024-09-12T02:34:07.266139+0000","last_peered":"2024-09-12T02:34:07.266139+0000","last_clean":"2024-09-12T02:34:07.266139+0000","last_became_active":"2024-09-12T02:34:01.060669+0000","last_became_peered":"2024-09-12T02:34:01.060669+0000","last_unstale":"2024-09-12T02:34:07.266139+0000","last_undegraded":"2024-09-12T02:34:07.266139+0000","last_fullsized":"2024-09-12T02:34:07.266139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:43.501329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T02:34:08.836765+0000","last_change":"2024-09-12T02:34:01.074156+0000","last_active":"2024-09-12T02:34:08.836765+0000","last_peered":"2024-09-12T02:34:08.836765+0000","last_clean":"2024-09-12T02:34:08.836765+0000","last_became_active":"2024-09-12T02:34:01.073860+0000","last_became_peered":"2024-09-12T02:34:01.073860+0000","last_unstale":"2024-09-12T02:34:08.836765+0000","last_undegraded":"2024-09-12T02:34:08.836765+0000","last_fullsized":"2024-09-12T02:34:08.836765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:00.029885+0000","last_clean_scrub_stamp":"2024-09-12T02:34:00.029885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.040748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476748,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":704005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":113181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":113215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":704061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":113055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:24.131 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:34:24.131 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:34:24.132 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:34:24.132 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T02:34:24.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.263+0000 7f2e140e4640 1 Processor -- start 2024-09-12T02:34:24.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.263+0000 7f2e140e4640 1 -- start start 2024-09-12T02:34:24.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e140e4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e140e4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e0c0ae550 0x7f2e0c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e140e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0c06cb30 con 0x7f2e0c147360 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e140e4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c0d0e50 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e140e4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c06bfb0 con 0x7f2e0c0ae550 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.264+0000 7f2e1167f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57096/0 (socket says 172.21.15.119:57096) 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 -- 172.21.15.119:0/2250333349 learned_addr learned my addr 172.21.15.119:0/2250333349 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e12681640 1 --2- 172.21.15.119:0/2250333349 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c0ae550 0x7f2e0c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 -- 172.21.15.119:0/2250333349 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c0ae550 msgr2=0x7f2e0c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 --2- 172.21.15.119:0/2250333349 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c0ae550 0x7f2e0c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 -- 172.21.15.119:0/2250333349 >> v1:172.21.15.153:6789/0 conn(0x7f2e0c147360 legacy=0x7f2e0c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.265+0000 7f2e1167f640 1 -- 172.21.15.119:0/2250333349 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c06c290 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e1167f640 1 --2- 172.21.15.119:0/2250333349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ced30 tx=0x7f2dfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de43a174db32132 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e10e7e640 1 -- 172.21.15.119:0/2250333349 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc037070 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e10e7e640 1 -- 172.21.15.119:0/2250333349 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc032440 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e10e7e640 1 -- 172.21.15.119:0/2250333349 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc032810 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 -- 172.21.15.119:0/2250333349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 msgr2=0x7f2e0c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 --2- 172.21.15.119:0/2250333349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ced30 tx=0x7f2dfc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 -- 172.21.15.119:0/2250333349 shutdown_connections 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 --2- 172.21.15.119:0/2250333349 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c0ae550 0x7f2e0c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 --2- 172.21.15.119:0/2250333349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c0d0910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 -- 172.21.15.119:0/2250333349 >> 172.21.15.119:0/2250333349 conn(0x7f2e0c0b2f40 msgr2=0x7f2e0c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 -- 172.21.15.119:0/2250333349 shutdown_connections 2024-09-12T02:34:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.266+0000 7f2e140e4640 1 -- 172.21.15.119:0/2250333349 wait complete. 2024-09-12T02:34:24.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.267+0000 7f2e140e4640 1 Processor -- start 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 -- start start 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c0ae550 0x7f2e0c141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c147360 0x7f2e0c1f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c070fa0 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c06c850 con 0x7f2e0c0ae550 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e140e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c06bc10 con 0x7f2e0c147360 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e1167f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e1167f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57100/0 (socket says 172.21.15.119:57100) 2024-09-12T02:34:24.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e1167f640 1 -- 172.21.15.119:0/1372024389 learned_addr learned my addr 172.21.15.119:0/1372024389 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e11e80640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c0ae550 0x7f2e0c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.268+0000 7f2e12681640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c147360 0x7f2e0c1f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 -- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c147360 msgr2=0x7f2e0c1f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c147360 0x7f2e0c1f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 -- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c0ae550 msgr2=0x7f2e0c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c0ae550 0x7f2e0c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 -- 172.21.15.119:0/1372024389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c141ab0 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e1167f640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc02a220 tx=0x7f2dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc041020 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0306c0 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c15b900 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc037040 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.269+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c143a80 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.270+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0c0d0910 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.271+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dfc044020 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.271+0000 7f2e027fc640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 0x7f2df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.271+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2dfc0ab8b0 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.271+0000 7f2e11e80640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 0x7f2df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.271+0000 7f2e11e80640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 0x7f2df006e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001780 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.275+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2dfc04b030 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.476+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e0c0cf790 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.476+0000 7f2e027fc640 1 -- 172.21.15.119:0/1372024389 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2dfc079f20 con 0x7f2e0c0d04a0 2024-09-12T02:34:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:24.477 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 msgr2=0x7f2df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 0x7f2df006e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001780 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2024-09-12T02:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 msgr2=0x7f2e0c145030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc02a220 tx=0x7f2dfc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 shutdown_connections 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2df006be30 0x7f2df006e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c147360 0x7f2e0c1f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e0c0d04a0 0x7f2e0c145030 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 --2- 172.21.15.119:0/1372024389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c0ae550 0x7f2e0c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 >> 172.21.15.119:0/1372024389 conn(0x7f2e0c0b2f40 msgr2=0x7f2e0c0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 shutdown_connections 2024-09-12T02:34:24.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.478+0000 7f2e140e4640 1 -- 172.21.15.119:0/1372024389 wait complete. 2024-09-12T02:34:24.489 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:34:24.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.587+0000 7f23acd1a640 1 Processor -- start 2024-09-12T02:34:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.587+0000 7f23acd1a640 1 -- start start 2024-09-12T02:34:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23acd1a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f23a806dbd0 0x7f23a809b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23acd1a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80d1970 con 0x7f23a815e740 2024-09-12T02:34:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23acd1a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80d0780 con 0x7f23a80d1540 2024-09-12T02:34:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23acd1a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f23a815eb20 con 0x7f23a806dbd0 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23a6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f23a806dbd0 0x7f23a809b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23a6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f23a806dbd0 0x7f23a809b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57114/0 (socket says 172.21.15.119:57114) 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23a659c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f23a815e740 0x7f23a806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49292/0 (socket says 172.21.15.119:49292) 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.588+0000 7f23a6d9d640 1 -- 172.21.15.119:0/814378393 learned_addr learned my addr 172.21.15.119:0/814378393 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a6d9d640 1 -- 172.21.15.119:0/814378393 >> v1:172.21.15.153:6789/0 conn(0x7f23a80d1540 legacy=0x7f23a8070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a6d9d640 1 -- 172.21.15.119:0/814378393 >> v1:172.21.15.119:6789/0 conn(0x7f23a815e740 legacy=0x7f23a806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a6d9d640 1 -- 172.21.15.119:0/814378393 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80d0a60 con 0x7f23a806dbd0 2024-09-12T02:34:24.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a6d9d640 1 --2- 172.21.15.119:0/814378393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a809b690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4291b61bce82862 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a559a640 1 -- 172.21.15.119:0/814378393 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0037070 con 0x7f23a806dbd0 2024-09-12T02:34:24.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a559a640 1 -- 172.21.15.119:0/814378393 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0032640 con 0x7f23a806dbd0 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.589+0000 7f23a559a640 1 -- 172.21.15.119:0/814378393 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0032a10 con 0x7f23a806dbd0 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 -- 172.21.15.119:0/814378393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 msgr2=0x7f23a809b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 --2- 172.21.15.119:0/814378393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a809b690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a002a330 comp rx=0 tx=0).stop 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 -- 172.21.15.119:0/814378393 shutdown_connections 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 --2- 172.21.15.119:0/814378393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a809b690 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 -- 172.21.15.119:0/814378393 >> 172.21.15.119:0/814378393 conn(0x7f23a80d23a0 msgr2=0x7f23a80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 -- 172.21.15.119:0/814378393 shutdown_connections 2024-09-12T02:34:24.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.590+0000 7f23acd1a640 1 -- 172.21.15.119:0/814378393 wait complete. 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.591+0000 7f23acd1a640 1 Processor -- start 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.591+0000 7f23acd1a640 1 -- start start 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23a80d1540 0x7f23a80ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a815e740 0x7f23a80b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23a806dfe0 con 0x7f23a806dbd0 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80d1020 con 0x7f23a815e740 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23acd1a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23a806cd20 con 0x7f23a80d1540 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57124/0 (socket says 172.21.15.119:57124) 2024-09-12T02:34:24.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 -- 172.21.15.119:0/3264664238 learned_addr learned my addr 172.21.15.119:0/3264664238 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 -- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23a80d1540 msgr2=0x7f23a80ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23a80d1540 0x7f23a80ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 -- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a815e740 msgr2=0x7f23a80b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a815e740 0x7f23a80b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.592+0000 7f23a659c640 1 -- 172.21.15.119:0/3264664238 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80cb010 con 0x7f23a806dbd0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f23a659c640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f239800c730 tx=0x7f239800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398017070 con 0x7f23a806dbd0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239800ce40 con 0x7f23a806dbd0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a80b6d20 con 0x7f23a806dbd0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239800a800 con 0x7f23a806dbd0 2024-09-12T02:34:24.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.593+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a80b72e0 con 0x7f23a806dbd0 2024-09-12T02:34:24.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.594+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a806d0b0 con 0x7f23a806dbd0 2024-09-12T02:34:24.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.594+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f239801a070 con 0x7f23a806dbd0 2024-09-12T02:34:24.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.595+0000 7f239effd640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.595+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f239808a700 con 0x7f23a806dbd0 2024-09-12T02:34:24.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.595+0000 7f23a5d9b640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.595+0000 7f23a5d9b640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23a815b750 tx=0x7f23900079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.599+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2398058d80 con 0x7f23a806dbd0 2024-09-12T02:34:24.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.797+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23a80d1cb0 con 0x7f23a806dbd0 2024-09-12T02:34:24.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.798+0000 7f239effd640 1 -- 172.21.15.119:0/3264664238 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f2398058680 con 0x7f23a806dbd0 2024-09-12T02:34:24.798 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:24.799 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:24.799 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 msgr2=0x7f238806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23a815b750 tx=0x7f23900079b0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 msgr2=0x7f23a80c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f239800c730 tx=0x7f239800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 shutdown_connections 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a815e740 0x7f23a80b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23a80d1540 0x7f23a80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 --2- 172.21.15.119:0/3264664238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23a806dbd0 0x7f23a80c9640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 >> 172.21.15.119:0/3264664238 conn(0x7f23a80d23a0 msgr2=0x7f23a80b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 shutdown_connections 2024-09-12T02:34:24.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.800+0000 7f23acd1a640 1 -- 172.21.15.119:0/3264664238 wait complete. 2024-09-12T02:34:24.811 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:24.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.909+0000 7f189881e640 1 Processor -- start 2024-09-12T02:34:24.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.909+0000 7f189881e640 1 -- start start 2024-09-12T02:34:24.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189881e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f189406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189881e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18940d2700 con 0x7f189415e760 2024-09-12T02:34:24.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189881e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18940cedb0 con 0x7f18940cfcc0 2024-09-12T02:34:24.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189881e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f18940cf090 con 0x7f18940d4fd0 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f189415e760 0x7f18940cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49306/0 (socket says 172.21.15.119:49306) 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f189259c640 1 -- 172.21.15.119:0/510531818 learned_addr learned my addr 172.21.15.119:0/510531818 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690604559 0 0) 0x7f1884001110 con 0x7f189415e760 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1892d9d640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f189406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1880003520 con 0x7f189415e760 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 431436650 0 0) 0x7f1880003520 con 0x7f189415e760 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 msgr2=0x7f189406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f189406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 >> v1:172.21.15.153:6789/0 conn(0x7f18940cfcc0 legacy=0x7f18940d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18940b3c80 con 0x7f189415e760 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f1884001840 con 0x7f189415e760 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 >> v1:172.21.15.119:6789/0 conn(0x7f189415e760 legacy=0x7f18940cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18800039e0 0x7f1880003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.910+0000 7f1891d9b640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f1880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1891d9b640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1880004d40 0x7f18800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f18940cf090 con 0x7f18800039e0 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f188000ba70 con 0x7f1880004d40 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f188000bc70 con 0x7f18940d4fd0 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18800039e0 0x7f1880003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f188bfff640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f1880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1892d9d640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1880004d40 0x7f18800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 -- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 msgr2=0x7f1880004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:24.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f1880004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 -- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1880004d40 msgr2=0x7f18800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1880004d40 0x7f18800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f189259c640 1 -- 172.21.15.119:0/510531818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1880003520 con 0x7f18800039e0 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f1892d9d640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1880004d40 0x7f18800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.911+0000 7f188bfff640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18940d4fd0 0x7f1880004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189259c640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18800039e0 0x7f1880003e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f188400c490 tx=0x7f1880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5969dd53074e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188400c0e0 con 0x7f18800039e0 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1884034070 con 0x7f18800039e0 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f1891d9b640 1 -- 172.21.15.119:0/510531818 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884005d30 con 0x7f18800039e0 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 -- 172.21.15.119:0/510531818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18800039e0 msgr2=0x7f1880003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 --2- 172.21.15.119:0/510531818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18800039e0 0x7f1880003e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f188400c490 tx=0x7f1880005830 comp rx=0 tx=0).stop 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f1892d9d640 1 -- 172.21.15.119:0/510531818 reap_dead start 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 -- 172.21.15.119:0/510531818 shutdown_connections 2024-09-12T02:34:24.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 -- 172.21.15.119:0/510531818 >> 172.21.15.119:0/510531818 conn(0x7f189408bfc0 msgr2=0x7f18940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:24.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 -- 172.21.15.119:0/510531818 shutdown_connections 2024-09-12T02:34:24.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.912+0000 7f189881e640 1 -- 172.21.15.119:0/510531818 wait complete. 2024-09-12T02:34:24.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 Processor -- start 2024-09-12T02:34:24.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 -- start start 2024-09-12T02:34:24.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18800039e0 0x7f18941539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 0x7f18940cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f189406cdd0 con 0x7f18940b6020 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18940b3920 con 0x7f18940cb850 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f189881e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f189406cf50 con 0x7f18800039e0 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f188bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f188bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57146/0 (socket says 172.21.15.119:57146) 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.914+0000 7f188bfff640 1 -- 172.21.15.119:0/589812492 learned_addr learned my addr 172.21.15.119:0/589812492 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f1892d9d640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 0x7f18940cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f189259c640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18800039e0 0x7f18941539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 -- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18800039e0 msgr2=0x7f18941539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18800039e0 0x7f18941539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 -- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 msgr2=0x7f18940cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:24.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 0x7f18940cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 -- 172.21.15.119:0/589812492 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18940b93f0 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f1892d9d640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 0x7f18940cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188bfff640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e7b0 tx=0x7f187c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0050d0 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c018070 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c00c660 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18940b96d0 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.915+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18940b9c90 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.916+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189406d9c0 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.917+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f187c00c800 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.917+0000 7f188affd640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 0x7f187406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.917+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f187c08aec0 con 0x7f18940b6020 2024-09-12T02:34:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.917+0000 7f189259c640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 0x7f187406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.918+0000 7f189259c640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 0x7f187406e320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18800057e0 tx=0x7f188402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:24.921+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f187c0595c0 con 0x7f18940b6020 2024-09-12T02:34:25.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.121+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f189406d6e0 con 0x7f18940b6020 2024-09-12T02:34:25.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.122+0000 7f188affd640 1 -- 172.21.15.119:0/589812492 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f187c058ec0 con 0x7f18940b6020 2024-09-12T02:34:25.123 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:25.123 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:25.125 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:25.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.123+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 msgr2=0x7f187406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.123+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 0x7f187406e320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18800057e0 tx=0x7f188402e000 comp rx=0 tx=0).stop 2024-09-12T02:34:25.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.123+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 msgr2=0x7f18940b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.123+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e7b0 tx=0x7f187c00ec70 comp rx=0 tx=0).stop 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 shutdown_connections 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f187406be60 0x7f187406e320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18940cb850 0x7f18940cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18940b6020 0x7f18940b64a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 --2- 172.21.15.119:0/589812492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f18800039e0 0x7f18941539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 >> 172.21.15.119:0/589812492 conn(0x7f189408bfc0 msgr2=0x7f18940d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 shutdown_connections 2024-09-12T02:34:25.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.124+0000 7f189881e640 1 -- 172.21.15.119:0/589812492 wait complete. 2024-09-12T02:34:25.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:25.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.233+0000 7f92c8add640 1 Processor -- start 2024-09-12T02:34:25.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.234+0000 7f92c8add640 1 -- start start 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.234+0000 7f92c8add640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.234+0000 7f92c8add640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c409b690 0x7f92c406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.234+0000 7f92c8add640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c406e020 con 0x7f92c406d4c0 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c8add640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f92c415eb20 con 0x7f92c409b690 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c8add640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92c406d260 con 0x7f92c415e740 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c409b690 0x7f92c406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c2d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f92c406d4c0 0x7f92c406d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49318/0 (socket says 172.21.15.119:49318) 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92c409b690 0x7f92c406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57154/0 (socket says 172.21.15.119:57154) 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c2d9d640 1 -- 172.21.15.119:0/992695898 learned_addr learned my addr 172.21.15.119:0/992695898 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c259c640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 -- 172.21.15.119:0/992695898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 msgr2=0x7f92c40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 -- 172.21.15.119:0/992695898 >> v1:172.21.15.119:6789/0 conn(0x7f92c406d4c0 legacy=0x7f92c406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c1d9b640 1 -- 172.21.15.119:0/992695898 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c40d0780 con 0x7f92c409b690 2024-09-12T02:34:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c159a640 1 -- 172.21.15.119:0/992695898 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819841882 0 0) 0x7f92c406e020 con 0x7f92c406d4c0 2024-09-12T02:34:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.235+0000 7f92c259c640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c1d9b640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c406cd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f92b80097d0 tx=0x7f92b802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262756f2a8dde408 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c159a640 1 -- 172.21.15.119:0/992695898 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8037070 con 0x7f92c409b690 2024-09-12T02:34:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c159a640 1 -- 172.21.15.119:0/992695898 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8032440 con 0x7f92c409b690 2024-09-12T02:34:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c159a640 1 -- 172.21.15.119:0/992695898 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8032810 con 0x7f92c409b690 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 -- 172.21.15.119:0/992695898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 msgr2=0x7f92c406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c406cd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f92b80097d0 tx=0x7f92b802a250 comp rx=0 tx=0).stop 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 -- 172.21.15.119:0/992695898 shutdown_connections 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c406cd20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 --2- 172.21.15.119:0/992695898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 -- 172.21.15.119:0/992695898 >> 172.21.15.119:0/992695898 conn(0x7f92c40d23a0 msgr2=0x7f92c40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 -- 172.21.15.119:0/992695898 shutdown_connections 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.236+0000 7f92c8add640 1 -- 172.21.15.119:0/992695898 wait complete. 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 Processor -- start 2024-09-12T02:34:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 -- start start 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c406d4c0 0x7f92c40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40d1020 con 0x7f92c409b690 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40d0d40 con 0x7f92c406d4c0 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.238+0000 7f92c8add640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92c409ba90 con 0x7f92c415e740 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57156/0 (socket says 172.21.15.119:57156) 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 -- 172.21.15.119:0/3670288361 learned_addr learned my addr 172.21.15.119:0/3670288361 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c2d9d640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c259c640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c406d4c0 0x7f92c40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 -- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 msgr2=0x7f92c40cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 -- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c406d4c0 msgr2=0x7f92c40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c406d4c0 0x7f92c40c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 -- 172.21.15.119:0/3670288361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c40ca3c0 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c1d9b640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92b8035040 tx=0x7f92b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8037040 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8030770 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c40cb240 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8030b60 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.239+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c40cac20 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.240+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c406cd20 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.241+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92b8044020 con 0x7f92c409b690 2024-09-12T02:34:25.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.241+0000 7f92b2ffd640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.241+0000 7f92c259c640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.241+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f92b80ab730 con 0x7f92c409b690 2024-09-12T02:34:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.242+0000 7f92c259c640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 0x7f92a406e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f92b400a990 tx=0x7f92b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.246+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92c40ca3c0 con 0x7f92c409b690 2024-09-12T02:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.417+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92c40b8320 con 0x7f92c409b690 2024-09-12T02:34:25.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.418+0000 7f92b2ffd640 1 -- 172.21.15.119:0/3670288361 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f92b8032e20 con 0x7f92c409b690 2024-09-12T02:34:25.419 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:25.419 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 msgr2=0x7f92a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 0x7f92a406e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f92b400a990 tx=0x7f92b4008040 comp rx=0 tx=0).stop 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 msgr2=0x7f92c415cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92b8035040 tx=0x7f92b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 shutdown_connections 2024-09-12T02:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92c415e740 0x7f92c40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92c409b690 0x7f92c415cb00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 --2- 172.21.15.119:0/3670288361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92c406d4c0 0x7f92c40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 >> 172.21.15.119:0/3670288361 conn(0x7f92c40d23a0 msgr2=0x7f92c40b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 shutdown_connections 2024-09-12T02:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.420+0000 7f92c8add640 1 -- 172.21.15.119:0/3670288361 wait complete. 2024-09-12T02:34:25.432 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:25.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.529+0000 7f96a8e9b640 1 Processor -- start 2024-09-12T02:34:25.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.529+0000 7f96a8e9b640 1 -- start start 2024-09-12T02:34:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.530+0000 7f96a8e9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96a4145bc0 0x7f96a415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.530+0000 7f96a8e9b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96a40ae140 0x7f96a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.530+0000 7f96a8e9b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a40b3570 con 0x7f96a409aa30 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.530+0000 7f96a8e9b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f96a40b3850 con 0x7f96a4145bc0 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.530+0000 7f96a8e9b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f96a40b3b30 con 0x7f96a40ae140 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96a4145bc0 0x7f96a415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a2d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f96a409aa30 0x7f96a40b1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49326/0 (socket says 172.21.15.119:49326) 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a2d9d640 1 -- 172.21.15.119:0/1502551599 learned_addr learned my addr 172.21.15.119:0/1502551599 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a1d9b640 1 --2- 172.21.15.119:0/1502551599 >> v2:172.21.15.153:3300/0 conn(0x7f96a40ae140 0x7f96a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a259c640 1 -- 172.21.15.119:0/1502551599 >> v2:172.21.15.153:3300/0 conn(0x7f96a40ae140 msgr2=0x7f96a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a259c640 1 --2- 172.21.15.119:0/1502551599 >> v2:172.21.15.153:3300/0 conn(0x7f96a40ae140 0x7f96a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a259c640 1 -- 172.21.15.119:0/1502551599 >> v1:172.21.15.119:6789/0 conn(0x7f96a409aa30 legacy=0x7f96a40b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a159a640 1 -- 172.21.15.119:0/1502551599 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050947012 0 0) 0x7f96a40b3570 con 0x7f96a409aa30 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.531+0000 7f96a259c640 1 -- 172.21.15.119:0/1502551599 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40b1610 con 0x7f96a4145bc0 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a259c640 1 --2- 172.21.15.119:0/1502551599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4145bc0 0x7f96a415ca70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f96940097a0 tx=0x7f969402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d17c652143a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a159a640 1 -- 172.21.15.119:0/1502551599 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694037070 con 0x7f96a4145bc0 2024-09-12T02:34:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a159a640 1 -- 172.21.15.119:0/1502551599 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694032440 con 0x7f96a4145bc0 2024-09-12T02:34:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a159a640 1 -- 172.21.15.119:0/1502551599 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694032810 con 0x7f96a4145bc0 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1502551599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4145bc0 msgr2=0x7f96a415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1502551599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4145bc0 0x7f96a415ca70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f96940097a0 tx=0x7f969402a270 comp rx=0 tx=0).stop 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1502551599 shutdown_connections 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1502551599 >> v2:172.21.15.153:3300/0 conn(0x7f96a40ae140 0x7f96a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1502551599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4145bc0 0x7f96a415ca70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1502551599 >> 172.21.15.119:0/1502551599 conn(0x7f96a4073490 msgr2=0x7f96a40b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.532+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1502551599 shutdown_connections 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.533+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1502551599 wait complete. 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.534+0000 7f96a8e9b640 1 Processor -- start 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.534+0000 7f96a8e9b640 1 -- start start 2024-09-12T02:34:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a40ae140 0x7f96a40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 0x7f96a40b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96a4145fa0 con 0x7f96a409aa30 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406c150 con 0x7f96a4145bc0 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40b62c0 con 0x7f96a40ae140 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57180/0 (socket says 172.21.15.119:57180) 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 -- 172.21.15.119:0/1215146582 learned_addr learned my addr 172.21.15.119:0/1215146582 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a2d9d640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 0x7f96a40b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a1d9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a40ae140 0x7f96a40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 -- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a40ae140 msgr2=0x7f96a40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a40ae140 0x7f96a40d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 -- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 msgr2=0x7f96a40b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 0x7f96a40b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 -- 172.21.15.119:0/1215146582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40b5d00 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a2d9d640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 0x7f96a40b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a259c640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9694000c00 tx=0x7f96940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694037050 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694038040 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.535+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a40b5fe0 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.536+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694004490 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.536+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a4152c70 con 0x7f96a409aa30 2024-09-12T02:34:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.536+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a406c4e0 con 0x7f96a409aa30 2024-09-12T02:34:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.537+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9694030900 con 0x7f96a409aa30 2024-09-12T02:34:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.537+0000 7f969affd640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 0x7f968406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.537+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f96940abe30 con 0x7f96a409aa30 2024-09-12T02:34:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.537+0000 7f96a1d9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 0x7f968406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.538+0000 7f96a1d9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 0x7f968406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96a415c290 tx=0x7f968c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.542+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f969407a650 con 0x7f96a409aa30 2024-09-12T02:34:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.739+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a40d1140 con 0x7f96a409aa30 2024-09-12T02:34:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.740+0000 7f969affd640 1 -- 172.21.15.119:0/1215146582 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f9694079f50 con 0x7f96a409aa30 2024-09-12T02:34:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:25.741 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:25.741 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 msgr2=0x7f968406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 0x7f968406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96a415c290 tx=0x7f968c008040 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 msgr2=0x7f96a4152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9694000c00 tx=0x7f96940046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 shutdown_connections 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f968406be30 0x7f968406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a4145bc0 0x7f96a40b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a40ae140 0x7f96a40d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 --2- 172.21.15.119:0/1215146582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a409aa30 0x7f96a4152730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 >> 172.21.15.119:0/1215146582 conn(0x7f96a4073490 msgr2=0x7f96a415dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 shutdown_connections 2024-09-12T02:34:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:25.742+0000 7f96a8e9b640 1 -- 172.21.15.119:0/1215146582 wait complete. 2024-09-12T02:34:26.155 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:34:00.381345+0000', 'modified': '2024-09-12T02:34:19.586393+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/29298975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 29298975}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 29298975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-09-12T02:34:26.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:34:26.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:34:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.257+0000 7f4d97cd7640 1 Processor -- start 2024-09-12T02:34:26.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 -- start start 2024-09-12T02:34:26.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4d9015c520 0x7f4d9009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d900b1620 0x7f4d900b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d900d0980 0x7f4d900d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4d900cec00 con 0x7f4d9015c520 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9009bd90 con 0x7f4d900d0980 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.258+0000 7f4d97cd7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d900d0010 con 0x7f4d900b1620 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4d9015c520 0x7f4d9009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4d9015c520 0x7f4d9009b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57194/0 (socket says 172.21.15.119:57194) 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 -- 172.21.15.119:0/3435725917 learned_addr learned my addr 172.21.15.119:0/3435725917 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95272640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d900b1620 0x7f4d900b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d96274640 1 --2- 172.21.15.119:0/3435725917 >> v2:172.21.15.153:3300/0 conn(0x7f4d900d0980 0x7f4d900d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 -- 172.21.15.119:0/3435725917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d900b1620 msgr2=0x7f4d900b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d900b1620 0x7f4d900b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 -- 172.21.15.119:0/3435725917 >> v2:172.21.15.153:3300/0 conn(0x7f4d900d0980 msgr2=0x7f4d900d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3435725917 >> v2:172.21.15.153:3300/0 conn(0x7f4d900d0980 0x7f4d900d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.259+0000 7f4d95a73640 1 -- 172.21.15.119:0/3435725917 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d900d02f0 con 0x7f4d9015c520 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d9015c520 0x7f4d9009b720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d900b3ea0 tx=0x7f4d8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bdb3040f727dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d94a71640 1 -- 172.21.15.119:0/3435725917 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84037070 con 0x7f4d9015c520 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d94a71640 1 -- 172.21.15.119:0/3435725917 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84032440 con 0x7f4d9015c520 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d94a71640 1 -- 172.21.15.119:0/3435725917 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84032810 con 0x7f4d9015c520 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3435725917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d9015c520 msgr2=0x7f4d9009b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d9015c520 0x7f4d9009b720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d900b3ea0 tx=0x7f4d8402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3435725917 shutdown_connections 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3435725917 >> v2:172.21.15.153:3300/0 conn(0x7f4d900d0980 0x7f4d900d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d900b1620 0x7f4d900b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3435725917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d9015c520 0x7f4d9009b720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3435725917 >> 172.21.15.119:0/3435725917 conn(0x7f4d900d23a0 msgr2=0x7f4d900d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3435725917 shutdown_connections 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.260+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3435725917 wait complete. 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 Processor -- start 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 -- start start 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 0x7f4d90153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d9015c520 0x7f4d900b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9015c900 con 0x7f4d900d0980 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d900d05d0 con 0x7f4d900b1620 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d97cd7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d900b6290 con 0x7f4d9015c520 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57208/0 (socket says 172.21.15.119:57208) 2024-09-12T02:34:26.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.262+0000 7f4d95272640 1 -- 172.21.15.119:0/3148618409 learned_addr learned my addr 172.21.15.119:0/3148618409 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d96274640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d9015c520 0x7f4d900b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 0x7f4d90153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 -- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d9015c520 msgr2=0x7f4d900b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d9015c520 0x7f4d900b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 -- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 msgr2=0x7f4d90153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 0x7f4d90153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 -- 172.21.15.119:0/3148618409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d901f2da0 con 0x7f4d900d0980 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 0x7f4d90153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d95272640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00d800 tx=0x7f4d8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d827fc640 1 -- 172.21.15.119:0/3148618409 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c018030 con 0x7f4d900d0980 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d827fc640 1 -- 172.21.15.119:0/3148618409 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0096a0 con 0x7f4d900d0980 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d901f2ac0 con 0x7f4d900d0980 2024-09-12T02:34:26.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d827fc640 1 -- 172.21.15.119:0/3148618409 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c009870 con 0x7f4d900d0980 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.263+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d900b5550 con 0x7f4d900d0980 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.264+0000 7f4d827fc640 1 -- 172.21.15.119:0/3148618409 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d8c01b070 con 0x7f4d900d0980 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.265+0000 7f4d827fc640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 0x7f4d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.265+0000 7f4d827fc640 1 -- 172.21.15.119:0/3148618409 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4d8c08b380 con 0x7f4d900d0980 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.265+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 0x7f4d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.266+0000 7f4d95a73640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 0x7f4d7406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d84034000 tx=0x7f4d8402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.266+0000 7f4d9aa71740 1 Processor -- start 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.266+0000 7f4d9aa71740 1 -- start start 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b04a80 0x557d80b076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d80a69520 con 0x557d80b072c0 2024-09-12T02:34:26.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557d80a113e0 con 0x557d80b04a80 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x557d80a654e0 con 0x557d80b08a50 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57212/0 (socket says 172.21.15.119:57212) 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 -- 172.21.15.119:0/2604570455 learned_addr learned my addr 172.21.15.119:0/2604570455 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d96274640 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95272640 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b04a80 0x557d80b076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 -- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 msgr2=0x557d80b018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 -- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b04a80 msgr2=0x557d80b076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b04a80 0x557d80b076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 -- 172.21.15.119:0/2604570455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d80a2c2f0 con 0x557d80b072c0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d95a73640 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d840326b0 tx=0x7f4d8402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c070afef4e6f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d737fe640 1 -- 172.21.15.119:0/2604570455 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8404c070 con 0x557d80b072c0 2024-09-12T02:34:26.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d737fe640 1 -- 172.21.15.119:0/2604570455 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84032e20 con 0x557d80b072c0 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.267+0000 7f4d737fe640 1 -- 172.21.15.119:0/2604570455 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84037040 con 0x557d80b072c0 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2604570455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 msgr2=0x557d80b4ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d840326b0 tx=0x7f4d8402c000 comp rx=0 tx=0).stop 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2604570455 shutdown_connections 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b04a80 0x557d80b076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2604570455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b4ca60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2604570455 >> 172.21.15.119:0/2604570455 conn(0x557d80b03a80 msgr2=0x557d80b4bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2604570455 shutdown_connections 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.268+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2604570455 wait complete. 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.269+0000 7f4d9aa71740 1 -- start start 2024-09-12T02:34:26.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.269+0000 7f4d9aa71740 1 Processor -- start 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b2a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d80b02f20 con 0x557d80b072c0 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557d809f2450 con 0x557d80b49880 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x557d80b4d290 con 0x557d80b08a50 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 10 client.0 _ll_register_callbacks cb 0x557d8077bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57218/0 (socket says 172.21.15.119:57218) 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 -- 172.21.15.119:0/588165870 learned_addr learned my addr 172.21.15.119:0/588165870 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d96274640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b2a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95272640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 -- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 msgr2=0x557d80b274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 -- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 msgr2=0x557d80b2a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b2a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 -- 172.21.15.119:0/588165870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d8077c2d0 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d95a73640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009630 tx=0x7f4d84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f2c315ca02b58d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8404c070 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4d8403c430 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d84032e20 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4d84037070 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 10 client.4641 fetch_fsmap learned FSMap version 8 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.270+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557d808466b0 con 0x557d80b072c0 2024-09-12T02:34:26.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84032e20 con 0x557d80b072c0 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f4d8405a080 con 0x557d80b072c0 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 20 client.4641 populate_metadata read hostname 'smithi119' 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b28f30 0x557d80b29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 4 client.4641 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 --> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d80a76c50 con 0x557d80b28f30 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d95272640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b28f30 0x557d80b29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d95272640 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b28f30 0x557d80b29310 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c7b06518fd69bc server_cookie=7042efdd34192847 in_seq=0 out_seq=0 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.271+0000 7f4d70ff9640 10 client.4641 ms_handle_connect on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d70ff9640 1 -- 172.21.15.119:0/588165870 <== mds.0 v2:172.21.15.153:6833/29298975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d80a76c50 con 0x557d80b28f30 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d70ff9640 10 client.4641 handle_command_reply: tid=0 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 client.4641 shutdown 2024-09-12T02:34:26.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 msgr2=0x557d80b26e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009630 tx=0x7f4d84004730 comp rx=0 tx=0).stop 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 shutdown_connections 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b2a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b08a50 0x557d80b274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.272+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b28f30 0x557d80b29310 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/588165870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b072c0 0x557d80b26e30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d70ff9640 0 client.4641 ms_handle_reset on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 >> 172.21.15.119:0/588165870 conn(0x557d80b04a80 msgr2=0x557d80b4ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 shutdown_connections 2024-09-12T02:34:26.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d9aa71740 1 -- 172.21.15.119:0/588165870 wait complete. 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.273+0000 7f4d9aa71740 20 client.4641 trim_cache size 0 max 16384 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 Processor -- start 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 -- start start 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b2a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d901feeb0 con 0x557d80b08a50 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d901fe210 con 0x557d80b49880 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.291+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d901fe860 con 0x557d80b072c0 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57228/0 (socket says 172.21.15.119:57228) 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 -- 172.21.15.119:0/2945042326 learned_addr learned my addr 172.21.15.119:0/2945042326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95a73640 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b2a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d96274640 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 -- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 msgr2=0x557d80b2a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b2a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 -- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 msgr2=0x557d80b491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 -- 172.21.15.119:0/2945042326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d80b03820 con 0x557d80b08a50 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d95272640 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c055750 tx=0x7f4d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0b64ab8dd0e848 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d72ffd640 1 -- 172.21.15.119:0/2945042326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c057390 con 0x557d80b08a50 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d72ffd640 1 -- 172.21.15.119:0/2945042326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0575f0 con 0x557d80b08a50 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.292+0000 7f4d72ffd640 1 -- 172.21.15.119:0/2945042326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0711d0 con 0x557d80b08a50 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2945042326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 msgr2=0x557d80b2ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c055750 tx=0x7f4d8c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2945042326 shutdown_connections 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80b491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b2ba20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/2945042326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b2a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2945042326 >> 172.21.15.119:0/2945042326 conn(0x557d80b04a80 msgr2=0x557d80afcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2945042326 shutdown_connections 2024-09-12T02:34:26.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- 172.21.15.119:0/2945042326 wait complete. 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 -- start start 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.293+0000 7f4d9aa71740 1 Processor -- start 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b61890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80bcc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d80b286c0 con 0x557d80b08a50 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557d80b02f20 con 0x557d80b49880 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x557d80b5f560 con 0x557d80b072c0 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d9aa71740 10 client.0 _ll_register_callbacks cb 0x7f4d8404a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d95272640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57232/0 (socket says 172.21.15.119:57232) 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d95a73640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d95272640 1 -- 172.21.15.119:0/78953474 learned_addr learned my addr 172.21.15.119:0/78953474 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.294+0000 7f4d96274640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80bcc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 -- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 msgr2=0x557d80b61890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b61890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 -- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 msgr2=0x557d80bcc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80bcc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 -- 172.21.15.119:0/78953474 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d80b631d0 con 0x557d80b08a50 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d95272640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c05d860 tx=0x7f4d8c089440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b8d08a5826238 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0711d0 con 0x557d80b08a50 2024-09-12T02:34:26.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4d8c055960 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d8c0575f0 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c089200 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 10 client.4647 fetch_fsmap learned FSMap version 8 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557d80b70240 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0575f0 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f4d8c025060 con 0x557d80b08a50 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 20 client.4647 populate_metadata read hostname 'smithi119' 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b6ed60 0x557d80b6f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 4 client.4647 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.295+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 --> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] -- command(tid 0: {"prefix": "status"}) -- 0x557d80a70fa0 con 0x557d80b6ed60 2024-09-12T02:34:26.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d95a73640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b6ed60 0x557d80b6f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d70ff9640 10 client.4647 ms_handle_connect on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d95a73640 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b6ed60 0x557d80b6f140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88afa73165588a8 server_cookie=bf7f49a17d7bbecd in_seq=0 out_seq=0 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d70ff9640 1 -- 172.21.15.119:0/78953474 <== mds.0 v2:172.21.15.153:6833/29298975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557d80a70fa0 con 0x557d80b6ed60 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d70ff9640 10 client.4647 handle_command_reply: tid=0 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 client.4647 shutdown 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 msgr2=0x557d80b6fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c05d860 tx=0x7f4d8c089440 comp rx=0 tx=0).stop 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 shutdown_connections 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d80b49880 0x557d80bcc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:6833/29298975,v1:172.21.15.153:6835/29298975] conn(0x557d80b6ed60 0x557d80b6f140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d80b08a50 0x557d80b6fd00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 --2- 172.21.15.119:0/78953474 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x557d80b072c0 0x557d80b61890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d70ff9640 0 client.4647 ms_handle_reset on v2:172.21.15.153:6833/29298975 2024-09-12T02:34:26.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 >> 172.21.15.119:0/78953474 conn(0x557d80b04a80 msgr2=0x557d80b27250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 shutdown_connections 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.296+0000 7f4d9aa71740 1 -- 172.21.15.119:0/78953474 wait complete. 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d9aa71740 20 client.4647 trim_cache size 0 max 16384 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "3a2846d1-7a08-4c1c-a77f-ac792ab98e22", 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4309, 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-09-12T02:34:26.851 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 25.255025466999999, 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 8, 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 27, 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 27, 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 31.270958854 2024-09-12T02:34:26.852 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:34:26.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 msgr2=0x7f4d7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 0x7f4d7406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d84034000 tx=0x7f4d8402e000 comp rx=0 tx=0).stop 2024-09-12T02:34:26.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 msgr2=0x7f4d900b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00d800 tx=0x7f4d8c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 shutdown_connections 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f4d7406be30 0x7f4d7406e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d9015c520 0x7f4d900b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d900d0980 0x7f4d900b5d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 --2- 172.21.15.119:0/3148618409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d900b1620 0x7f4d90153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 >> 172.21.15.119:0/3148618409 conn(0x7f4d900d23a0 msgr2=0x7f4d9009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 shutdown_connections 2024-09-12T02:34:26.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:26.297+0000 7f4d97cd7640 1 -- 172.21.15.119:0/3148618409 wait complete. 2024-09-12T02:34:26.855 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:34:27.574 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:34:27.574 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:34:27.574 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:34:27.574 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:34:27.825 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:34:27.825 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T02:34:27.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:27.826 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:34:27.846 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T02:34:27.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:27.847 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:34:27.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:27.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-12T02:34:28.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.025 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:34:28.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.043 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-12T02:34:28.113 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2024-09-12T02:34:28.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:34:28.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.115 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:34:28.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T02:34:28.206 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-12T02:34:28.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:34:28.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.208 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:34:28.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T02:34:28.336 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-12T02:34:28.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:34:28.337 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-12T02:34:28.338 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:34:28.338 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:28.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:34:28.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.442+0000 7fa3efc53640 1 Processor -- start 2024-09-12T02:34:28.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.442+0000 7fa3efc53640 1 -- start start 2024-09-12T02:34:28.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3efc53640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e815b300 0x7fa3e80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3efc53640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3efc53640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e80cdbe0 con 0x7fa3e80cd3f0 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3efc53640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e80728a0 con 0x7fa3e815b300 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3efc53640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e80cd900 con 0x7fa3e806f8d0 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3ed9ef640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e815b300 0x7fa3e80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3ed9ef640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e815b300 0x7fa3e80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50402/0 (socket says 172.21.15.119:50402) 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.443+0000 7fa3ed9ef640 1 -- 172.21.15.119:0/1420594230 learned_addr learned my addr 172.21.15.119:0/1420594230 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ee1f0640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ed9ef640 1 -- 172.21.15.119:0/1420594230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 msgr2=0x7fa3e815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ed9ef640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ed9ef640 1 -- 172.21.15.119:0/1420594230 >> v1:172.21.15.153:6789/0 conn(0x7fa3e80cd3f0 legacy=0x7fa3e806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ed9ef640 1 -- 172.21.15.119:0/1420594230 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e8072250 con 0x7fa3e815b300 2024-09-12T02:34:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ee1f0640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:28.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.444+0000 7fa3ed9ef640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e80cceb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009e50 tx=0x7fa3d802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0d62f361819143 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3ec9ed640 1 -- 172.21.15.119:0/1420594230 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8036070 con 0x7fa3e815b300 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3ec9ed640 1 -- 172.21.15.119:0/1420594230 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8031600 con 0x7fa3e815b300 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3ec9ed640 1 -- 172.21.15.119:0/1420594230 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80319d0 con 0x7fa3e815b300 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 -- 172.21.15.119:0/1420594230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 msgr2=0x7fa3e80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e80cceb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009e50 tx=0x7fa3d802a6c0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 -- 172.21.15.119:0/1420594230 shutdown_connections 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 --2- 172.21.15.119:0/1420594230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e80cceb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 -- 172.21.15.119:0/1420594230 >> 172.21.15.119:0/1420594230 conn(0x7fa3e8067d70 msgr2=0x7fa3e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:28.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 -- 172.21.15.119:0/1420594230 shutdown_connections 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.445+0000 7fa3efc53640 1 -- 172.21.15.119:0/1420594230 wait complete. 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.447+0000 7fa3efc53640 1 Processor -- start 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.447+0000 7fa3efc53640 1 -- start start 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.447+0000 7fa3efc53640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.447+0000 7fa3efc53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e80cd3f0 0x7fa3e80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.447+0000 7fa3efc53640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3efc53640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80d0160 con 0x7fa3e815b300 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3efc53640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80cffe0 con 0x7fa3e80cd3f0 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3efc53640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e8072d30 con 0x7fa3e806f8d0 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50406/0 (socket says 172.21.15.119:50406) 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 -- 172.21.15.119:0/3730032088 learned_addr learned my addr 172.21.15.119:0/3730032088 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:28.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ed9ef640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ed1ee640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e80cd3f0 0x7fa3e80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 -- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 msgr2=0x7fa3e81509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e81509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 -- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e80cd3f0 msgr2=0x7fa3e80aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e80cd3f0 0x7fa3e80aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 -- 172.21.15.119:0/3730032088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e80ab640 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3ee1f0640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c820 tx=0x7fa3e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0015070 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e0004240 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e81f5ed0 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000ce10 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.448+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e8150f00 con 0x7fa3e815b300 2024-09-12T02:34:28.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.449+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e80ce990 con 0x7fa3e815b300 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.450+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3e0007830 con 0x7fa3e815b300 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.450+0000 7fa3e67fc640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 0x7fa3d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.450+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa3e008b370 con 0x7fa3e815b300 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.451+0000 7fa3ed9ef640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 0x7fa3d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.451+0000 7fa3ed9ef640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 0x7fa3d406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8033000 tx=0x7fa3d8009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:28.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.455+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3e80ce990 con 0x7fa3e815b300 2024-09-12T02:34:28.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.655+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa3e81f6640 con 0x7fa3e815b300 2024-09-12T02:34:28.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.655+0000 7fa3e67fc640 1 -- 172.21.15.119:0/3730032088 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fa3e0059390 con 0x7fa3e815b300 2024-09-12T02:34:28.656 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:34:28.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 msgr2=0x7fa3d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 0x7fa3d406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8033000 tx=0x7fa3d8009000 comp rx=0 tx=0).stop 2024-09-12T02:34:28.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 msgr2=0x7fa3e806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c820 tx=0x7fa3e000cce0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 shutdown_connections 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3d406be30 0x7fa3d406e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e815b300 0x7fa3e806e0b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e80cd3f0 0x7fa3e80aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 --2- 172.21.15.119:0/3730032088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e806f8d0 0x7fa3e81509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 >> 172.21.15.119:0/3730032088 conn(0x7fa3e8067d70 msgr2=0x7fa3e8159750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 shutdown_connections 2024-09-12T02:34:28.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28.657+0000 7fa3efc53640 1 -- 172.21.15.119:0/3730032088 wait complete. 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:34:28.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:34:28.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:34:28.670 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:34:28.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.670 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42764sec preferred_lft 42764sec 2024-09-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:28.688 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:34:28.688 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:28.688 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:28.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:34:28.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-09-12T02:34:28.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-09-12T02:34:28.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:34:28.689 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:28.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:28.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.824 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:34:28.847 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-12T02:34:28.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:28.849 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-12T02:34:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-12T02:34:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:34:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:34:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:34:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:34:28.907 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:29.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:29.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:29.033 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:34:29.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:29.051 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-12T02:34:29.106 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:29.106 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:29.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:34:29.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:34:29.107 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:29.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:29.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:34:29.223 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:29.223 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:29.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:34:29.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:34:29.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:34:29.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:34:29.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:34:29.224 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:29.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:29.338 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:29.339 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:29.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-12T02:34:29.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:34:29.339 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:29.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:29.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:29.415 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:34:29.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:29.430 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:29.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:29.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:29.485 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:34:29.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:29.485 DEBUG:teuthology.orchestra.run.smithi119:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:34:29.595 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:34:29.595 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:34:29.596 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:29.753 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:34:29.753 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:34:29.753 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:29.754 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:29.754 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:29.771 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-09-12T02:34:29.772 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3a2846d1-7a08-4c1c-a77f-ac792ab98e22" will pass to kernel 2024-09-12T02:34:29.773 INFO:teuthology.orchestra.run.smithi119.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:34:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:34:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:34:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:34:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:34:29.775 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:34:29.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:29.775 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:29.840 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:29.936 INFO:teuthology.orchestra.run.smithi119.stdout:client4656 2024-09-12T02:34:29.936 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:29.936 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:29.953 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:30.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:30.047 INFO:teuthology.orchestra.run.smithi119.stdout:client4656 2024-09-12T02:34:30.048 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:30.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:30.104 INFO:teuthology.orchestra.run.smithi119.stdout:client4656 2024-09-12T02:34:30.104 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a2846d1-7a08-4c1c-a77f-ac792ab98e22.client4656/status') 2024-09-12T02:34:30.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stdout:instance: client.4656 (3)192.168.0.1:0/4208068911 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stdout:blocklisted: false 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records in 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records out 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:69 bytes copied, 3.7286e-05 s, 1.9 MB/s 2024-09-12T02:34:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:30.169 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-12T02:34:30.169 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:34:30.169 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:34:30.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:34:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 Processor -- start 2024-09-12T02:34:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 -- start start 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f147c15b300 0x7f147c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f147c0cd3f0 0x7f147c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147c0cdbe0 con 0x7f147c072d30 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0728a0 con 0x7f147c15b300 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.268+0000 7f1481733640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0cd900 con 0x7f147c0cd3f0 2024-09-12T02:34:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f147c15b300 0x7f147c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f147c072d30 0x7f147c0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43652/0 (socket says 172.21.15.119:43652) 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147b7fe640 1 -- 172.21.15.119:0/1039134043 learned_addr learned my addr 172.21.15.119:0/1039134043 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147a7fc640 1 --2- 172.21.15.119:0/1039134043 >> v2:172.21.15.153:3300/0 conn(0x7f147c0cd3f0 0x7f147c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147affd640 1 -- 172.21.15.119:0/1039134043 >> v2:172.21.15.153:3300/0 conn(0x7f147c0cd3f0 msgr2=0x7f147c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147affd640 1 --2- 172.21.15.119:0/1039134043 >> v2:172.21.15.153:3300/0 conn(0x7f147c0cd3f0 0x7f147c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147affd640 1 -- 172.21.15.119:0/1039134043 >> v1:172.21.15.119:6789/0 conn(0x7f147c072d30 legacy=0x7f147c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f1479ffb640 1 -- 172.21.15.119:0/1039134043 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121547030 0 0) 0x7f147c0cdbe0 con 0x7f147c072d30 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.269+0000 7f147affd640 1 -- 172.21.15.119:0/1039134043 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c072250 con 0x7f147c15b300 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f147affd640 1 --2- 172.21.15.119:0/1039134043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c15b300 0x7f147c0cceb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b57c0 tx=0x7f146c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae2c5493082b583 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1479ffb640 1 -- 172.21.15.119:0/1039134043 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c037070 con 0x7f147c15b300 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1479ffb640 1 -- 172.21.15.119:0/1039134043 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c032440 con 0x7f147c15b300 2024-09-12T02:34:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1479ffb640 1 -- 172.21.15.119:0/1039134043 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c032810 con 0x7f147c15b300 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 -- 172.21.15.119:0/1039134043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c15b300 msgr2=0x7f147c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 --2- 172.21.15.119:0/1039134043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c15b300 0x7f147c0cceb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b57c0 tx=0x7f146c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 -- 172.21.15.119:0/1039134043 shutdown_connections 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 --2- 172.21.15.119:0/1039134043 >> v2:172.21.15.153:3300/0 conn(0x7f147c0cd3f0 0x7f147c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 --2- 172.21.15.119:0/1039134043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c15b300 0x7f147c0cceb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 -- 172.21.15.119:0/1039134043 >> 172.21.15.119:0/1039134043 conn(0x7f147c067d70 msgr2=0x7f147c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 -- 172.21.15.119:0/1039134043 shutdown_connections 2024-09-12T02:34:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.270+0000 7f1481733640 1 -- 172.21.15.119:0/1039134043 wait complete. 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 Processor -- start 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 -- start start 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 0x7f147c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 0x7f147c1e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0d0160 con 0x7f147c0cd3f0 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0cffe0 con 0x7f147c15b300 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.272+0000 7f1481733640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f147c06f700 con 0x7f147c072d30 2024-09-12T02:34:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50428/0 (socket says 172.21.15.119:50428) 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 -- 172.21.15.119:0/3932494780 learned_addr learned my addr 172.21.15.119:0/3932494780 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147b7fe640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 0x7f147c1e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147affd640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 0x7f147c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 -- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 msgr2=0x7f147c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 0x7f147c156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 -- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 msgr2=0x7f147c1e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 0x7f147c1e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 -- 172.21.15.119:0/3932494780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c158240 con 0x7f147c0cd3f0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147b7fe640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 0x7f147c1e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147affd640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 0x7f147c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f147a7fc640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1470007f20 tx=0x7f147000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470014620 con 0x7f147c0cd3f0 2024-09-12T02:34:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1470019070 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c1571a0 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470014a00 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.273+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c157760 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.274+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c06fac0 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.275+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1470014ba0 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.275+0000 7f14637fe640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 0x7f146806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.275+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f147008bae0 con 0x7f147c0cd3f0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.275+0000 7f147affd640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 0x7f146806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.275+0000 7f147affd640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 0x7f146806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f146c034000 tx=0x7f146c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.279+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f147005a150 con 0x7f147c0cd3f0 2024-09-12T02:34:30.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.478+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f147c15a440 con 0x7f147c0cd3f0 2024-09-12T02:34:30.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.479+0000 7f14637fe640 1 -- 172.21.15.119:0/3932494780 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f1470059a50 con 0x7f147c0cd3f0 2024-09-12T02:34:30.479 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 msgr2=0x7f146806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 0x7f146806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f146c034000 tx=0x7f146c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 msgr2=0x7f147c140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1470007f20 tx=0x7f147000e570 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 shutdown_connections 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f146806be30 0x7f146806e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c15b300 0x7f147c1e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cd3f0 0x7f147c140e10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 --2- 172.21.15.119:0/3932494780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c072d30 0x7f147c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 >> 172.21.15.119:0/3932494780 conn(0x7f147c067d70 msgr2=0x7f147c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 shutdown_connections 2024-09-12T02:34:30.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30.481+0000 7f1481733640 1 -- 172.21.15.119:0/3932494780 wait complete. 2024-09-12T02:34:30.492 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:34:30.492 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:34:30.492 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-12T02:34:30.492 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T02:34:30.492 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:34:30.493 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:34:30.493 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:34:30.493 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:34:30.493 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:34:30.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.493 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-12T02:34:30.509 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:30.509 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:30.509 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:30.509 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:30.510 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42762sec preferred_lft 42762sec 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:e9:5b:cd:06:04 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::58a9:acff:fe50:724a/64 scope link 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:e9:5b:cd:06:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::2ce9:5bff:fecd:604/64 scope link 2024-09-12T02:34:30.511 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.512 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:34:30.572 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-12T02:34:30.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.574 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-12T02:34:30.630 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-12T02:34:30.631 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:34:30.631 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:34:30.631 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:34:30.631 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:34:30.631 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:30.631 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:30.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:34:30.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:34:30.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:34:30.632 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:30.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.757 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:34:30.773 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:34:30.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.774 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-12T02:34:30.829 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T02:34:30.830 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:30.830 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:30.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:34:30.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T02:34:30.830 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:30.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.946 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether fe:1b:10:f5:9f:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:34:30.971 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:34:30.972 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.972 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::fc1b:10ff:fef5:9fcf/64 scope link 2024-09-12T02:34:30.972 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:30.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:30.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether fe:1b:10:f5:9f:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:34:31.037 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:34:31.038 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:31.038 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::fc1b:10ff:fef5:9fcf/64 scope link 2024-09-12T02:34:31.038 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:31.039 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T02:34:31.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T02:34:31.040 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:31.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.190 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:31.190 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:34:31.190 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2024-09-12T02:34:31.190 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:34:31.190 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:34:31.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:31.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:31.266 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T02:34:31.280 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:34:31.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:31.281 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:34:31.336 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:34:31.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:31.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T02:34:31.420 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T02:34:31.420 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T02:34:31.420 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:31.429 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T02:34:31.429 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T02:34:31.429 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:31.429 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:31.429 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-09-12T02:34:31.434 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=3a2846d1-7a08-4c1c-a77f-ac792ab98e22" will pass to kernel 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:34:31.435 INFO:teuthology.orchestra.run.smithi119.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:34:31.437 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:34:31.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:31.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:34:31.503 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:31.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:31.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.600 INFO:teuthology.orchestra.run.smithi119.stdout:client4668 2024-09-12T02:34:31.600 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:31.600 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:31.617 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:31.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:31.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.712 INFO:teuthology.orchestra.run.smithi119.stdout:client4668 2024-09-12T02:34:31.713 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:31.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:31.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.768 INFO:teuthology.orchestra.run.smithi119.stdout:client4668 2024-09-12T02:34:31.768 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a2846d1-7a08-4c1c-a77f-ac792ab98e22.client4668/status') 2024-09-12T02:34:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:31.826 INFO:teuthology.orchestra.run.smithi119.stdout:instance: client.4668 (3)192.168.0.2:0/4041436857 2024-09-12T02:34:31.826 INFO:teuthology.orchestra.run.smithi119.stdout:blocklisted: false 2024-09-12T02:34:31.826 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records in 2024-09-12T02:34:31.826 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records out 2024-09-12T02:34:31.826 INFO:teuthology.orchestra.run.smithi119.stderr:69 bytes copied, 2.2675e-05 s, 3.0 MB/s 2024-09-12T02:34:31.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:31.833 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-12T02:34:31.833 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:34:31.833 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:34:31.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:34:31.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.931+0000 7f8459911640 1 Processor -- start 2024-09-12T02:34:31.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 -- start start 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f84540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84540ae140 0x7f84540ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84540b6520 con 0x7f845415e5b0 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f84540b2c30 con 0x7f84540ae140 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8459911640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f84540aeb30 con 0x7f845415e990 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.932+0000 7f8452ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f845415e5b0 0x7f84540b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43668/0 (socket says 172.21.15.119:43668) 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 -- 172.21.15.119:0/652286926 learned_addr learned my addr 172.21.15.119:0/652286926 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f84537fe640 1 --2- 172.21.15.119:0/652286926 >> v2:172.21.15.153:3300/0 conn(0x7f84540ae140 0x7f84540ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f84527fc640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f84540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241592904 0 0) 0x7f84540b6520 con 0x7f845415e5b0 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f843c003520 con 0x7f845415e5b0 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1368622549 0 0) 0x7f843c003520 con 0x7f845415e5b0 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 msgr2=0x7f84540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f84540b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 >> v2:172.21.15.153:3300/0 conn(0x7f84540ae140 msgr2=0x7f84540ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 --2- 172.21.15.119:0/652286926 >> v2:172.21.15.153:3300/0 conn(0x7f84540ae140 0x7f84540ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84540b1a40 con 0x7f845415e5b0 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f84440019f0 con 0x7f845415e5b0 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 >> v1:172.21.15.119:6789/0 conn(0x7f845415e5b0 legacy=0x7f84540b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f843c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f843c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84540b2c30 con 0x7f843c0039b0 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f84540aeb30 con 0x7f843c004d40 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f843c00b9c0 con 0x7f845415e990 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f843c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f84527fc640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f843c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f84537fe640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 -- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 msgr2=0x7f843c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845415e990 0x7f843c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 -- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f843c004d40 msgr2=0x7f843c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.933+0000 7f8452ffd640 1 -- 172.21.15.119:0/652286926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c003520 con 0x7f843c0039b0 2024-09-12T02:34:31.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.934+0000 7f8452ffd640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f843c003dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f844400a880 tx=0x7f843c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760273b2ddebcc09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.934+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844400a4a0 con 0x7f843c0039b0 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.934+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844402f070 con 0x7f843c0039b0 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.934+0000 7f8451ffb640 1 -- 172.21.15.119:0/652286926 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844402bd00 con 0x7f843c0039b0 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 -- 172.21.15.119:0/652286926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 msgr2=0x7f843c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 --2- 172.21.15.119:0/652286926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f843c003dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f844400a880 tx=0x7f843c005830 comp rx=0 tx=0).stop 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f84537fe640 1 -- 172.21.15.119:0/652286926 reap_dead start 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 -- 172.21.15.119:0/652286926 shutdown_connections 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 -- 172.21.15.119:0/652286926 >> 172.21.15.119:0/652286926 conn(0x7f8454073490 msgr2=0x7f84540b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 -- 172.21.15.119:0/652286926 shutdown_connections 2024-09-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.935+0000 7f8459911640 1 -- 172.21.15.119:0/652286926 wait complete. 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.936+0000 7f8459911640 1 Processor -- start 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.936+0000 7f8459911640 1 -- start start 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 0x7f84540caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 0x7f84540cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84540b0490 con 0x7f843c0039b0 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f84540b2000 con 0x7f845415f940 2024-09-12T02:34:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8459911640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f84540b5f40 con 0x7f8454150410 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50442/0 (socket says 172.21.15.119:50442) 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 -- 172.21.15.119:0/655762675 learned_addr learned my addr 172.21.15.119:0/655762675 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f84527fc640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 0x7f84540caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f84537fe640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 0x7f84540cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 -- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 msgr2=0x7f84540cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 0x7f84540cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 -- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 msgr2=0x7f84540caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 0x7f84540caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f8452ffd640 1 -- 172.21.15.119:0/655762675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845415fee0 con 0x7f843c0039b0 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f84537fe640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 0x7f84540cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.937+0000 7f84527fc640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 0x7f84540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f8452ffd640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f844402b550 tx=0x7f84540b1c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844402b8a0 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844402ba40 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84541601c0 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844402bdf0 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.938+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8454160780 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.939+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84540ae5f0 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.939+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8444034470 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.940+0000 7f843bfff640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 0x7f844006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.940+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f84440aba80 con 0x7f843c0039b0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.940+0000 7f84527fc640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 0x7f844006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.940+0000 7f84527fc640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 0x7f844006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f845415fd60 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:31.944+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f844407a180 con 0x7f843c0039b0 2024-09-12T02:34:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.145+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84540b0b40 con 0x7f843c0039b0 2024-09-12T02:34:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.145+0000 7f843bfff640 1 -- 172.21.15.119:0/655762675 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f8444079a80 con 0x7f843c0039b0 2024-09-12T02:34:32.146 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:34:32.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 msgr2=0x7f844006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 0x7f844006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f845415fd60 tx=0x7f8448008040 comp rx=0 tx=0).stop 2024-09-12T02:34:32.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 msgr2=0x7f84540cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f844402b550 tx=0x7f84540b1c10 comp rx=0 tx=0).stop 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 shutdown_connections 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f844006be30 0x7f844006e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8454150410 0x7f84540cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845415f940 0x7f84540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 --2- 172.21.15.119:0/655762675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c0039b0 0x7f84540cbfe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.147+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 >> 172.21.15.119:0/655762675 conn(0x7f8454073490 msgr2=0x7f84540746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.148+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 shutdown_connections 2024-09-12T02:34:32.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:32.148+0000 7f8459911640 1 -- 172.21.15.119:0/655762675 wait complete. 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:34:32.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:34:32.160 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:34:32.160 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:34:32.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:32.160 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-12T02:34:32.179 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-12T02:34:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:32.181 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:34:32.181 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:32.181 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:32.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:34:32.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-09-12T02:34:32.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-09-12T02:34:32.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:34:32.182 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:32.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:32.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:32.396 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:34:32.425 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T02:34:32.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:32.427 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-12T02:34:32.491 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-12T02:34:32.492 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:34:32.492 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:34:32.492 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:34:32.492 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:34:32.492 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:32.492 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:32.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:34:32.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:34:32.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:34:32.493 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:32.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:32.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:32.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:32.840 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:34:32.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:32.857 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-12T02:34:32.912 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:32.912 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:32.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:34:32.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T02:34:32.912 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.029 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:33.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:33.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.158 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:33.158 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:33.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-12T02:34:33.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:34:33.158 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:33.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:33.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:33.235 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:34:33.250 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:34:33.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:33.250 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:34:33.305 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:34:33.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:33.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T02:34:33.398 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T02:34:33.398 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T02:34:33.398 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:33.519 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T02:34:33.519 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T02:34:33.519 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:33.519 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:33.519 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-09-12T02:34:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3a2846d1-7a08-4c1c-a77f-ac792ab98e22" will pass to kernel 2024-09-12T02:34:33.527 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:34:33.527 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:34:33.527 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:34:33.527 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:34:33.527 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:34:33.528 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:34:33.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:33.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:34:33.558 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:33.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.654 INFO:teuthology.orchestra.run.smithi153.stdout:client4490 2024-09-12T02:34:33.655 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:33.655 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:33.671 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.767 INFO:teuthology.orchestra.run.smithi153.stdout:client4490 2024-09-12T02:34:33.767 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.823 INFO:teuthology.orchestra.run.smithi153.stdout:client4490 2024-09-12T02:34:33.824 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a2846d1-7a08-4c1c-a77f-ac792ab98e22.client4490/status') 2024-09-12T02:34:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:33.882 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4490 (3)192.168.0.1:0/414796158 2024-09-12T02:34:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-09-12T02:34:33.883 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-09-12T02:34:33.883 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-09-12T02:34:33.884 INFO:teuthology.orchestra.run.smithi153.stderr:68 bytes copied, 2.3196e-05 s, 2.9 MB/s 2024-09-12T02:34:33.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:33.890 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-12T02:34:33.890 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:34:33.890 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:34:33.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:34:34.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.001+0000 7f00ae791640 1 Processor -- start 2024-09-12T02:34:34.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.001+0000 7f00ae791640 1 -- start start 2024-09-12T02:34:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00ae791640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 0x7f00a80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00ae791640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 0x7f00a806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00ae791640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a80cdbe0 con 0x7f00a8072d30 2024-09-12T02:34:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00ae791640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f00a80728a0 con 0x7f00a80cd3f0 2024-09-12T02:34:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00ae791640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00a80cd900 con 0x7f00a815b300 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00acd2e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f00a8072d30 0x7f00a80b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43682/0 (socket says 172.21.15.119:43682) 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00acd2e640 1 -- 172.21.15.119:0/2070899428 learned_addr learned my addr 172.21.15.119:0/2070899428 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a7fff640 1 --2- 172.21.15.119:0/2070899428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 0x7f00a80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a77fe640 1 --2- 172.21.15.119:0/2070899428 >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 0x7f00a806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a6ffd640 1 -- 172.21.15.119:0/2070899428 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697122883 0 0) 0x7f00a80cdbe0 con 0x7f00a8072d30 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a6ffd640 1 -- 172.21.15.119:0/2070899428 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0090003520 con 0x7f00a8072d30 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a7fff640 1 -- 172.21.15.119:0/2070899428 >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 msgr2=0x7f00a806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a7fff640 1 --2- 172.21.15.119:0/2070899428 >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 0x7f00a806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a7fff640 1 -- 172.21.15.119:0/2070899428 >> v1:172.21.15.119:6789/0 conn(0x7f00a8072d30 legacy=0x7f00a80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a7fff640 1 -- 172.21.15.119:0/2070899428 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a8072250 con 0x7f00a815b300 2024-09-12T02:34:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.002+0000 7f00a77fe640 1 --2- 172.21.15.119:0/2070899428 >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 0x7f00a806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.003+0000 7f00a7fff640 1 --2- 172.21.15.119:0/2070899428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 0x7f00a80cceb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00980097a0 tx=0x7f009802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caac3dccb96ce2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.003+0000 7f00a6ffd640 1 -- 172.21.15.119:0/2070899428 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098037070 con 0x7f00a815b300 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.003+0000 7f00a6ffd640 1 -- 172.21.15.119:0/2070899428 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0098032440 con 0x7f00a815b300 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.003+0000 7f00a6ffd640 1 -- 172.21.15.119:0/2070899428 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980327f0 con 0x7f00a815b300 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 -- 172.21.15.119:0/2070899428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 msgr2=0x7f00a80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 --2- 172.21.15.119:0/2070899428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 0x7f00a80cceb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00980097a0 tx=0x7f009802a180 comp rx=0 tx=0).stop 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 -- 172.21.15.119:0/2070899428 shutdown_connections 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 --2- 172.21.15.119:0/2070899428 >> v2:172.21.15.153:3300/0 conn(0x7f00a80cd3f0 0x7f00a806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 --2- 172.21.15.119:0/2070899428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a815b300 0x7f00a80cceb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 -- 172.21.15.119:0/2070899428 >> 172.21.15.119:0/2070899428 conn(0x7f00a8067d70 msgr2=0x7f00a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 -- 172.21.15.119:0/2070899428 shutdown_connections 2024-09-12T02:34:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.004+0000 7f00ae791640 1 -- 172.21.15.119:0/2070899428 wait complete. 2024-09-12T02:34:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.005+0000 7f00ae791640 1 Processor -- start 2024-09-12T02:34:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.005+0000 7f00ae791640 1 -- start start 2024-09-12T02:34:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a80cd3f0 0x7f00a814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a815b300 0x7f00a814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80d0160 con 0x7f00a8072d30 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80cffe0 con 0x7f00a815b300 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00ae791640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00a806f700 con 0x7f00a80cd3f0 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50456/0 (socket says 172.21.15.119:50456) 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00a7fff640 1 -- 172.21.15.119:0/4185393027 learned_addr learned my addr 172.21.15.119:0/4185393027 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00a77fe640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a80cd3f0 0x7f00a814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.006+0000 7f00acd2e640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a815b300 0x7f00a814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 -- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a80cd3f0 msgr2=0x7f00a814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a80cd3f0 0x7f00a814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 -- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a815b300 msgr2=0x7f00a814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a815b300 0x7f00a814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 -- 172.21.15.119:0/4185393027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a814b350 con 0x7f00a8072d30 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a7fff640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f009802a1c0 tx=0x7f00980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098041020 con 0x7f00a8072d30 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009803d620 con 0x7f00a8072d30 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098037040 con 0x7f00a8072d30 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a814b630 con 0x7f00a8072d30 2024-09-12T02:34:34.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.007+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a814eb60 con 0x7f00a8072d30 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.008+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a815e250 con 0x7f00a8072d30 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.009+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0098044020 con 0x7f00a8072d30 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.009+0000 7f00a4ff9640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 0x7f009406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.009+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f00980ab720 con 0x7f00a8072d30 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.009+0000 7f00a77fe640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 0x7f009406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.009+0000 7f00a77fe640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 0x7f009406e320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f009c009560 tx=0x7f009c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.013+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00a815e250 con 0x7f00a8072d30 2024-09-12T02:34:34.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.213+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f00a814b800 con 0x7f00a8072d30 2024-09-12T02:34:34.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.214+0000 7f00a4ff9640 1 -- 172.21.15.119:0/4185393027 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f009804b030 con 0x7f00a8072d30 2024-09-12T02:34:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 msgr2=0x7f009406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 0x7f009406e320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f009c009560 tx=0x7f009c009190 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 msgr2=0x7f00a8155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f009802a1c0 tx=0x7f00980046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 shutdown_connections 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f009406be60 0x7f009406e320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a815b300 0x7f00a814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00a80cd3f0 0x7f00a814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 --2- 172.21.15.119:0/4185393027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00a8072d30 0x7f00a8155d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 >> 172.21.15.119:0/4185393027 conn(0x7f00a8067d70 msgr2=0x7f00a815db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 shutdown_connections 2024-09-12T02:34:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:34.216+0000 7f00ae791640 1 -- 172.21.15.119:0/4185393027 wait complete. 2024-09-12T02:34:34.227 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:34:34.227 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:34:34.227 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-12T02:34:34.227 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T02:34:34.228 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:34:34.228 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:34:34.228 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:34:34.228 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:34:34.228 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:34:34.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.228 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-12T02:34:34.245 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:34:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42767sec preferred_lft 42767sec 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ce:ec:5e:e7:a4:dd brd ff:ff:ff:ff:ff:ff 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::2072:77ff:fe41:4b34/64 scope link 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ce:ec:5e:e7:a4:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ccec:5eff:fee7:a4dd/64 scope link tentative 2024-09-12T02:34:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.248 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:34:34.309 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T02:34:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.311 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-12T02:34:34.368 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-12T02:34:34.368 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:34:34.368 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:34:34.369 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:34:34.369 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:34:34.369 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:34.369 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:34.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:34:34.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:34:34.370 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:34:34.370 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:34.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:34.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:34.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.497 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:34:34.513 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:34:34.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.513 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-12T02:34:34.569 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T02:34:34.569 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:34.569 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:34.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:34:34.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T02:34:34.569 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:34.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:34.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:34.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.686 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:34:34.710 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:dc:2c:6e:5e:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4dc:2cff:fe6e:5e67/64 scope link tentative 2024-09-12T02:34:34.711 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:34.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:34:34.777 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:34:34.777 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:34:34.777 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:dc:2c:6e:5e:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4dc:2cff:fe6e:5e67/64 scope link tentative 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:34:34.779 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T02:34:34.779 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:34.779 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:34.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T02:34:34.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:34:34.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T02:34:34.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T02:34:34.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T02:34:34.780 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:34.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:34.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:34.931 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:34:34.932 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T02:34:34.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-09-12T02:34:34.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:34:34.932 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T02:34:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:35.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:35.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:35.008 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T02:34:35.023 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:34:35.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:34:35.024 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:34:35.078 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:34:35.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:35.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T02:34:35.163 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T02:34:35.163 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T02:34:35.163 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T02:34:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T02:34:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-09-12T02:34:35.177 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=3a2846d1-7a08-4c1c-a77f-ac792ab98e22" will pass to kernel 2024-09-12T02:34:35.178 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-12T02:34:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:34:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:34:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:34:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:34:35.179 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:34:35.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:35.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:34:35.244 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:35.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:35.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:35.340 INFO:teuthology.orchestra.run.smithi153.stdout:client4624 2024-09-12T02:34:35.340 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:35.341 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:35.357 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:35.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:35.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:35.451 INFO:teuthology.orchestra.run.smithi153.stdout:client4624 2024-09-12T02:34:35.451 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:34:35.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:34:35.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:35.507 INFO:teuthology.orchestra.run.smithi153.stdout:client4624 2024-09-12T02:34:35.507 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a2846d1-7a08-4c1c-a77f-ac792ab98e22.client4624/status') 2024-09-12T02:34:35.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:34:35.565 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4624 (3)192.168.0.2:0/542060029 2024-09-12T02:34:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-09-12T02:34:35.566 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-09-12T02:34:35.566 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-09-12T02:34:35.566 INFO:teuthology.orchestra.run.smithi153.stderr:68 bytes copied, 2.3398e-05 s, 2.9 MB/s 2024-09-12T02:34:35.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T02:34:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:34:35.573 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T02:34:35.613 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-09-12T02:34:35.614 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:35.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.724+0000 7fbedad6d640 1 Processor -- start 2024-09-12T02:34:35.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.724+0000 7fbedad6d640 1 -- start start 2024-09-12T02:34:35.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.725+0000 7fbedad6d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbed4162060 0x7fbed40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.725+0000 7fbedad6d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 0x7fbed40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.725+0000 7fbedad6d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed406d9f0 con 0x7fbed4161c80 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.725+0000 7fbedad6d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbed406dcd0 con 0x7fbed4162060 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.725+0000 7fbedad6d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbed406dfb0 con 0x7fbed40b64b0 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed930a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 0x7fbed40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbed4162060 0x7fbed40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbed4162060 0x7fbed40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:51286/0 (socket says 172.21.15.119:51286) 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed930a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 0x7fbed40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:53604/0 (socket says 172.21.15.119:53604) 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 -- 172.21.15.119:0/972743625 learned_addr learned my addr 172.21.15.119:0/972743625 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed8b09640 1 --1- 172.21.15.119:0/972743625 >> v1:172.21.15.153:6789/0 conn(0x7fbed4161c80 0x7fbed406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:50702/0 (socket says 172.21.15.119:50702) 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 -- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 msgr2=0x7fbed40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 --2- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 0x7fbed40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 -- 172.21.15.119:0/972743625 >> v1:172.21.15.153:6789/0 conn(0x7fbed4161c80 legacy=0x7fbed406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.726+0000 7fbed3fff640 1 -- 172.21.15.119:0/972743625 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40d01f0 con 0x7fbed4162060 2024-09-12T02:34:35.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.727+0000 7fbed3fff640 1 --2- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4162060 0x7fbed40b5f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009870 tx=0x7fbec802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10abcfb0bcf1ad45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.728+0000 7fbed37fe640 1 -- 172.21.15.119:0/972743625 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8037070 con 0x7fbed4162060 2024-09-12T02:34:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.728+0000 7fbed37fe640 1 -- 172.21.15.119:0/972743625 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8032440 con 0x7fbed4162060 2024-09-12T02:34:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.728+0000 7fbed37fe640 1 -- 172.21.15.119:0/972743625 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8032810 con 0x7fbed4162060 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 -- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4162060 msgr2=0x7fbed40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 --2- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4162060 0x7fbed40b5f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009870 tx=0x7fbec802a270 comp rx=0 tx=0).stop 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 -- 172.21.15.119:0/972743625 shutdown_connections 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 --2- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed40b64b0 0x7fbed40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 --2- 172.21.15.119:0/972743625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4162060 0x7fbed40b5f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 -- 172.21.15.119:0/972743625 >> 172.21.15.119:0/972743625 conn(0x7fbed40d44f0 msgr2=0x7fbed40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 -- 172.21.15.119:0/972743625 shutdown_connections 2024-09-12T02:34:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.729+0000 7fbedad6d640 1 -- 172.21.15.119:0/972743625 wait complete. 2024-09-12T02:34:35.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.730+0000 7fbedad6d640 1 Processor -- start 2024-09-12T02:34:35.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.730+0000 7fbedad6d640 1 -- start start 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4161c80 0x7fbed415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed4162060 0x7fbed415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40cf360 con 0x7fbed40b64b0 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40cf1e0 con 0x7fbed4161c80 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbedad6d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbed40cf4e0 con 0x7fbed4162060 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbed8b09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbed8b09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50472/0 (socket says 172.21.15.119:50472) 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.731+0000 7fbed8b09640 1 -- 172.21.15.119:0/3538317856 learned_addr learned my addr 172.21.15.119:0/3538317856 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed3fff640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4161c80 0x7fbed415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed930a640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed4162060 0x7fbed415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 -- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed4162060 msgr2=0x7fbed415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed4162060 0x7fbed415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 -- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4161c80 msgr2=0x7fbed415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4161c80 0x7fbed415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 -- 172.21.15.119:0/3538317856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40b92d0 con 0x7fbed40b64b0 2024-09-12T02:34:35.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.732+0000 7fbed8b09640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c400 tx=0x7fbec400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.735+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40074e0 con 0x7fbed40b64b0 2024-09-12T02:34:35.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.735+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4007680 con 0x7fbed40b64b0 2024-09-12T02:34:35.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.735+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed40b95b0 con 0x7fbed40b64b0 2024-09-12T02:34:35.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.736+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4004a00 con 0x7fbed40b64b0 2024-09-12T02:34:35.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.736+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed415a940 con 0x7fbed40b64b0 2024-09-12T02:34:35.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.737+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed40b5f70 con 0x7fbed40b64b0 2024-09-12T02:34:35.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.737+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec401a020 con 0x7fbed40b64b0 2024-09-12T02:34:35.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.737+0000 7fbed17fa640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.738+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbec408a810 con 0x7fbed40b64b0 2024-09-12T02:34:35.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.738+0000 7fbed3fff640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.738+0000 7fbed3fff640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbec8034000 tx=0x7fbec802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.742+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbec40588c0 con 0x7fbed40b64b0 2024-09-12T02:34:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.910+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbed40ba470 con 0x7fbed40b64b0 2024-09-12T02:34:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.911+0000 7fbed17fa640 1 -- 172.21.15.119:0/3538317856 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7fbec4088e20 con 0x7fbed40b64b0 2024-09-12T02:34:35.912 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:35.913 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 msgr2=0x7fbec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbec8034000 tx=0x7fbec802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 msgr2=0x7fbed4155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c400 tx=0x7fbec400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 shutdown_connections 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbed4162060 0x7fbed415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed4161c80 0x7fbed415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 --2- 172.21.15.119:0/3538317856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbed40b64b0 0x7fbed4155c30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 >> 172.21.15.119:0/3538317856 conn(0x7fbed40d44f0 msgr2=0x7fbed406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 shutdown_connections 2024-09-12T02:34:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:35.914+0000 7fbedad6d640 1 -- 172.21.15.119:0/3538317856 wait complete. 2024-09-12T02:34:35.926 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:33:49.207672+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:33:58.198825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:33:59.356706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:34:03.076745+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T02:34:35.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:34:36.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.030+0000 7f0a91578640 1 Processor -- start 2024-09-12T02:34:36.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.030+0000 7f0a91578640 1 -- start start 2024-09-12T02:34:36.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.030+0000 7f0a91578640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a8c162340 0x7f0a8c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a91578640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c0cf280 0x7f0a8c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a91578640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8c15ff70 con 0x7f0a8c162c60 2024-09-12T02:34:36.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a91578640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8c06de90 con 0x7f0a8c162340 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a91578640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c0d4d10 con 0x7f0a8c0cf280 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a8c162340 0x7f0a8c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a8c162340 0x7f0a8c06d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50486/0 (socket says 172.21.15.119:50486) 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 -- 172.21.15.119:0/581291460 learned_addr learned my addr 172.21.15.119:0/581291460 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8a7fc640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c0cf280 0x7f0a8c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 -- 172.21.15.119:0/581291460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c0cf280 msgr2=0x7f0a8c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c0cf280 0x7f0a8c162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 -- 172.21.15.119:0/581291460 >> v1:172.21.15.153:6789/0 conn(0x7f0a8c162c60 legacy=0x7f0a8c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.031+0000 7f0a8affd640 1 -- 172.21.15.119:0/581291460 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c0d4ff0 con 0x7f0a8c162340 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a8affd640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c162340 0x7f0a8c06d740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5663927becec4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a89ffb640 1 -- 172.21.15.119:0/581291460 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c037070 con 0x7f0a8c162340 2024-09-12T02:34:36.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a89ffb640 1 -- 172.21.15.119:0/581291460 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c032440 con 0x7f0a8c162340 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a89ffb640 1 -- 172.21.15.119:0/581291460 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c032810 con 0x7f0a8c162340 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a91578640 1 -- 172.21.15.119:0/581291460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c162340 msgr2=0x7f0a8c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.032+0000 7f0a91578640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c162340 0x7f0a8c06d740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 -- 172.21.15.119:0/581291460 shutdown_connections 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c0cf280 0x7f0a8c162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 --2- 172.21.15.119:0/581291460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c162340 0x7f0a8c06d740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 -- 172.21.15.119:0/581291460 >> 172.21.15.119:0/581291460 conn(0x7f0a8c08bfc0 msgr2=0x7f0a8c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 -- 172.21.15.119:0/581291460 shutdown_connections 2024-09-12T02:34:36.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.033+0000 7f0a91578640 1 -- 172.21.15.119:0/581291460 wait complete. 2024-09-12T02:34:36.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.034+0000 7f0a91578640 1 Processor -- start 2024-09-12T02:34:36.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.034+0000 7f0a91578640 1 -- start start 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 0x7f0a8c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 0x7f0a8c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0cf6c0 con 0x7f0a8c0cf280 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0d52d0 con 0x7f0a8c162340 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a91578640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c1630f0 con 0x7f0a8c162c60 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50488/0 (socket says 172.21.15.119:50488) 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 -- 172.21.15.119:0/1359967078 learned_addr learned my addr 172.21.15.119:0/1359967078 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8a7fc640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 0x7f0a8c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8b7fe640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 0x7f0a8c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 -- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 msgr2=0x7f0a8c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 0x7f0a8c0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 -- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 msgr2=0x7f0a8c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 0x7f0a8c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 -- 172.21.15.119:0/1359967078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c0cd0d0 con 0x7f0a8c0cf280 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8b7fe640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 0x7f0a8c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8a7fc640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 0x7f0a8c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.035+0000 7f0a8affd640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.036+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c041070 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.036+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c03c890 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.036+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c0b7db0 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.036+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c037040 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.036+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c0b8dd0 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.037+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c162720 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.037+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a7c044070 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.038+0000 7f0a737fe640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 0x7f0a7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.038+0000 7f0a8a7fc640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 0x7f0a7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.038+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0a7c0abee0 con 0x7f0a8c0cf280 2024-09-12T02:34:36.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.038+0000 7f0a8a7fc640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 0x7f0a7806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0a23d0 tx=0x7f0a80008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.042+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a7c07a660 con 0x7f0a8c0cf280 2024-09-12T02:34:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.242+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0a8c08e640 con 0x7f0a8c0cf280 2024-09-12T02:34:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.242+0000 7f0a737fe640 1 -- 172.21.15.119:0/1359967078 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f0a7c079f60 con 0x7f0a8c0cf280 2024-09-12T02:34:36.243 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 msgr2=0x7f0a7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 0x7f0a7806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0a23d0 tx=0x7f0a80008040 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 msgr2=0x7f0a8c0b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 shutdown_connections 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0a7806be30 0x7f0a7806e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a8c162c60 0x7f0a8c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a8c162340 0x7f0a8c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 --2- 172.21.15.119:0/1359967078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a8c0cf280 0x7f0a8c0b8890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 >> 172.21.15.119:0/1359967078 conn(0x7f0a8c08bfc0 msgr2=0x7f0a8c1e8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 shutdown_connections 2024-09-12T02:34:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.245+0000 7f0a91578640 1 -- 172.21.15.119:0/1359967078 wait complete. 2024-09-12T02:34:36.260 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:34:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.364+0000 7f950ee06640 1 Processor -- start 2024-09-12T02:34:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.364+0000 7f950ee06640 1 -- start start 2024-09-12T02:34:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950ee06640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f950806d740 0x7f95080cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950ee06640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950815ff70 con 0x7f9508162e30 2024-09-12T02:34:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950ee06640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95080d4d10 con 0x7f9508162340 2024-09-12T02:34:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950ee06640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f950806de90 con 0x7f950806d740 2024-09-12T02:34:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f9507fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9508162e30 0x7f95080d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43698/0 (socket says 172.21.15.119:43698) 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f9507fff640 1 -- 172.21.15.119:0/2052472890 learned_addr learned my addr 172.21.15.119:0/2052472890 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950d3a3640 1 --2- 172.21.15.119:0/2052472890 >> v2:172.21.15.119:3300/0 conn(0x7f950806d740 0x7f95080cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f95077fe640 1 -- 172.21.15.119:0/2052472890 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481691393 0 0) 0x7f950815ff70 con 0x7f9508162e30 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f95077fe640 1 -- 172.21.15.119:0/2052472890 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f8003520 con 0x7f9508162e30 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950d3a3640 1 -- 172.21.15.119:0/2052472890 >> v1:172.21.15.153:6789/0 conn(0x7f9508162340 legacy=0x7f9508162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950d3a3640 1 -- 172.21.15.119:0/2052472890 >> v1:172.21.15.119:6789/0 conn(0x7f9508162e30 legacy=0x7f95080d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.365+0000 7f950d3a3640 1 -- 172.21.15.119:0/2052472890 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080d4ff0 con 0x7f950806d740 2024-09-12T02:34:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.366+0000 7f950d3a3640 1 --2- 172.21.15.119:0/2052472890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f950806d740 0x7f95080cf280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d90 tx=0x7f950002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2214c4ee7ac79eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.366+0000 7f95077fe640 1 -- 172.21.15.119:0/2052472890 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500007740 con 0x7f950806d740 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.366+0000 7f95077fe640 1 -- 172.21.15.119:0/2052472890 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000078e0 con 0x7f950806d740 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.366+0000 7f95077fe640 1 -- 172.21.15.119:0/2052472890 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500007cb0 con 0x7f950806d740 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 -- 172.21.15.119:0/2052472890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f950806d740 msgr2=0x7f95080cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 --2- 172.21.15.119:0/2052472890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f950806d740 0x7f95080cf280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d90 tx=0x7f950002a660 comp rx=0 tx=0).stop 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 -- 172.21.15.119:0/2052472890 shutdown_connections 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 --2- 172.21.15.119:0/2052472890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f950806d740 0x7f95080cf280 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 -- 172.21.15.119:0/2052472890 >> 172.21.15.119:0/2052472890 conn(0x7f950808bfc0 msgr2=0x7f95080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 -- 172.21.15.119:0/2052472890 shutdown_connections 2024-09-12T02:34:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.367+0000 7f950ee06640 1 -- 172.21.15.119:0/2052472890 wait complete. 2024-09-12T02:34:36.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.368+0000 7f950ee06640 1 Processor -- start 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.368+0000 7f950ee06640 1 -- start start 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950806d740 0x7f950814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9508162340 0x7f95080b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9508163270 con 0x7f9508162e30 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95080cf7c0 con 0x7f950806d740 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950ee06640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f950806dbb0 con 0x7f9508162340 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950d3a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950d3a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50504/0 (socket says 172.21.15.119:50504) 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950d3a3640 1 -- 172.21.15.119:0/1742444737 learned_addr learned my addr 172.21.15.119:0/1742444737 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f9507fff640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9508162340 0x7f95080b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.369+0000 7f950cba2640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950806d740 0x7f950814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 -- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9508162340 msgr2=0x7f95080b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9508162340 0x7f95080b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 -- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950806d740 msgr2=0x7f950814d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950806d740 0x7f950814d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 -- 172.21.15.119:0/1742444737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950814de40 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950d3a3640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f950002ac50 tx=0x7f9500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500040070 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9500031bc0 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95080b5f00 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500009450 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.370+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95080b64c0 con 0x7f9508162e30 2024-09-12T02:34:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.371+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080d52d0 con 0x7f9508162e30 2024-09-12T02:34:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.372+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9500039040 con 0x7f9508162e30 2024-09-12T02:34:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.372+0000 7f95057fa640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.372+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f95000ac890 con 0x7f9508162e30 2024-09-12T02:34:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.372+0000 7f950cba2640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.373+0000 7f950cba2640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 0x7f94ec06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f94fc001780 tx=0x7f94fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.376+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f950814de40 con 0x7f9508162e30 2024-09-12T02:34:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.548+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f950808e640 con 0x7f9508162e30 2024-09-12T02:34:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.548+0000 7f95057fa640 1 -- 172.21.15.119:0/1742444737 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f950007a8b0 con 0x7f9508162e30 2024-09-12T02:34:36.549 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-12T02:34:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 msgr2=0x7f94ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 0x7f94ec06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f94fc001780 tx=0x7f94fc009040 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 msgr2=0x7f9508161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f950002ac50 tx=0x7f9500004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 shutdown_connections 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9508162e30 0x7f9508161130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9508162340 0x7f95080b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 --2- 172.21.15.119:0/1742444737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950806d740 0x7f950814d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 >> 172.21.15.119:0/1742444737 conn(0x7f950808bfc0 msgr2=0x7f95080cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 shutdown_connections 2024-09-12T02:34:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.550+0000 7f950ee06640 1 -- 172.21.15.119:0/1742444737 wait complete. 2024-09-12T02:34:36.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:34:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.671+0000 7f817b991640 1 Processor -- start 2024-09-12T02:34:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.671+0000 7f817b991640 1 -- start start 2024-09-12T02:34:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817b991640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f8174166110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817b991640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81740cec90 con 0x7f817415b410 2024-09-12T02:34:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817b991640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81740cef70 con 0x7f8174072760 2024-09-12T02:34:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817b991640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81740cf250 con 0x7f81740b4270 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817972d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f817415b410 0x7f8174072050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43712/0 (socket says 172.21.15.119:43712) 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.672+0000 7f817972d640 1 -- 172.21.15.119:0/2202938417 learned_addr learned my addr 172.21.15.119:0/2202938417 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f8179f2e640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f8174166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538947914 0 0) 0x7f81740cec90 con 0x7f817415b410 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8160003520 con 0x7f817415b410 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675506774 0 0) 0x7f8160003520 con 0x7f817415b410 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 msgr2=0x7f8174166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f8174166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 >> v1:172.21.15.153:6789/0 conn(0x7f8174072760 legacy=0x7f81740cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740cf530 con 0x7f817415b410 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f8170001670 con 0x7f817415b410 2024-09-12T02:34:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 >> v1:172.21.15.119:6789/0 conn(0x7f817415b410 legacy=0x7f8174072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f81600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8160003f20 0x7f8160004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160004d40 0x7f81600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81740cf250 con 0x7f8160004d40 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f816000bad0 con 0x7f8160003f20 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f816000bcd0 con 0x7f81740b4270 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f8179f2e640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160004d40 0x7f81600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f817972d640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f81600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.673+0000 7f8178f2c640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8160003f20 0x7f8160004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 -- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8160003f20 msgr2=0x7f8160004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8160003f20 0x7f8160004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 -- 172.21.15.119:0/2202938417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160004d40 msgr2=0x7f81600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160004d40 0x7f81600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 -- 172.21.15.119:0/2202938417 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8160003520 con 0x7f81740b4270 2024-09-12T02:34:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.674+0000 7f817972d640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f81600039e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f817000c240 tx=0x7f8160005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907dacda13cb2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170007d10 con 0x7f81740b4270 2024-09-12T02:34:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8170005ad0 con 0x7f81740b4270 2024-09-12T02:34:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f816bfff640 1 -- 172.21.15.119:0/2202938417 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170007070 con 0x7f81740b4270 2024-09-12T02:34:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 -- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 msgr2=0x7f81600039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 --2- 172.21.15.119:0/2202938417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740b4270 0x7f81600039e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f817000c240 tx=0x7f8160005830 comp rx=0 tx=0).stop 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f8179f2e640 1 -- 172.21.15.119:0/2202938417 reap_dead start 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 -- 172.21.15.119:0/2202938417 shutdown_connections 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 -- 172.21.15.119:0/2202938417 >> 172.21.15.119:0/2202938417 conn(0x7f817406bdf0 msgr2=0x7f817406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 -- 172.21.15.119:0/2202938417 shutdown_connections 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.675+0000 7f817b991640 1 -- 172.21.15.119:0/2202938417 wait complete. 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 Processor -- start 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 -- start start 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 0x7f81740aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 0x7f81740ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f817415b970 con 0x7f81740b4270 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f817415b7f0 con 0x7f817414e650 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.677+0000 7f817b991640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f817415baf0 con 0x7f81740af4e0 2024-09-12T02:34:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50526/0 (socket says 172.21.15.119:50526) 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 -- 172.21.15.119:0/3955430428 learned_addr learned my addr 172.21.15.119:0/3955430428 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8178f2c640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 0x7f81740aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8179f2e640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 0x7f81740ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 -- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 msgr2=0x7f81740ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 0x7f81740ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 -- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 msgr2=0x7f81740aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 0x7f81740aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 -- 172.21.15.119:0/3955430428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817414ead0 con 0x7f81740b4270 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8178f2c640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 0x7f81740aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8179f2e640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 0x7f81740ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817972d640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f817000c240 tx=0x7f81740cf140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170042070 con 0x7f81740b4270 2024-09-12T02:34:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8170007270 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81740cac60 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170007620 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.678+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81740cb220 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.680+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81740ce770 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.680+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8170045070 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.680+0000 7f8169ffb640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 0x7f815806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.680+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f81700abbf0 con 0x7f81740b4270 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.680+0000 7f8178f2c640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 0x7f815806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.681+0000 7f8178f2c640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 0x7f815806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8174154530 tx=0x7f8164009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.684+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f817004c030 con 0x7f81740b4270 2024-09-12T02:34:36.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.852+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f81740d0690 con 0x7f81740b4270 2024-09-12T02:34:36.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.852+0000 7f8169ffb640 1 -- 172.21.15.119:0/3955430428 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f8170005aa0 con 0x7f81740b4270 2024-09-12T02:34:36.853 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-12T02:34:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 msgr2=0x7f815806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 0x7f815806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8174154530 tx=0x7f8164009040 comp rx=0 tx=0).stop 2024-09-12T02:34:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 msgr2=0x7f817415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f817000c240 tx=0x7f81740cf140 comp rx=0 tx=0).stop 2024-09-12T02:34:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 shutdown_connections 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f815806be30 0x7f815806e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81740af4e0 0x7f81740ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817414e650 0x7f81740aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 --2- 172.21.15.119:0/3955430428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81740b4270 0x7f817415d6d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 >> 172.21.15.119:0/3955430428 conn(0x7f817406bdf0 msgr2=0x7f817406fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 shutdown_connections 2024-09-12T02:34:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.854+0000 7f817b991640 1 -- 172.21.15.119:0/3955430428 wait complete. 2024-09-12T02:34:36.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T02:34:36.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.967+0000 7f041e99f640 1 Processor -- start 2024-09-12T02:34:36.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.967+0000 7f041e99f640 1 -- start start 2024-09-12T02:34:36.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e99f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f041815e630 0x7f041809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e99f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f041809af70 0x7f0418168300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e99f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180ce120 con 0x7f041815e250 2024-09-12T02:34:36.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e99f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f04180cdc90 con 0x7f041809af70 2024-09-12T02:34:36.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e99f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f04180cd080 con 0x7f041815e630 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f041809af70 0x7f0418168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f041809af70 0x7f0418168300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50542/0 (socket says 172.21.15.119:50542) 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 -- 172.21.15.119:0/1711278867 learned_addr learned my addr 172.21.15.119:0/1711278867 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041d19c640 1 --2- 172.21.15.119:0/1711278867 >> v2:172.21.15.153:3300/0 conn(0x7f041815e630 0x7f041809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 -- 172.21.15.119:0/1711278867 >> v2:172.21.15.153:3300/0 conn(0x7f041815e630 msgr2=0x7f041809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 --2- 172.21.15.119:0/1711278867 >> v2:172.21.15.153:3300/0 conn(0x7f041815e630 0x7f041809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 -- 172.21.15.119:0/1711278867 >> v1:172.21.15.153:6789/0 conn(0x7f041815e250 legacy=0x7f04180d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:36.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.968+0000 7f041e19e640 1 -- 172.21.15.119:0/1711278867 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180cd360 con 0x7f041809af70 2024-09-12T02:34:36.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.969+0000 7f041e19e640 1 --2- 172.21.15.119:0/1711278867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041809af70 0x7f0418168300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0418161f30 tx=0x7f041002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d90931e0714473e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.969+0000 7f041c99b640 1 -- 172.21.15.119:0/1711278867 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410036070 con 0x7f041809af70 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.969+0000 7f041c99b640 1 -- 172.21.15.119:0/1711278867 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0410031600 con 0x7f041809af70 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.969+0000 7f041c99b640 1 -- 172.21.15.119:0/1711278867 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100319d0 con 0x7f041809af70 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 -- 172.21.15.119:0/1711278867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041809af70 msgr2=0x7f0418168300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 --2- 172.21.15.119:0/1711278867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041809af70 0x7f0418168300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0418161f30 tx=0x7f041002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 -- 172.21.15.119:0/1711278867 shutdown_connections 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 --2- 172.21.15.119:0/1711278867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041809af70 0x7f0418168300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 --2- 172.21.15.119:0/1711278867 >> v2:172.21.15.153:3300/0 conn(0x7f041815e630 0x7f041809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 -- 172.21.15.119:0/1711278867 >> 172.21.15.119:0/1711278867 conn(0x7f04180d2140 msgr2=0x7f04180d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 -- 172.21.15.119:0/1711278867 shutdown_connections 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.970+0000 7f041e99f640 1 -- 172.21.15.119:0/1711278867 wait complete. 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.971+0000 7f041e99f640 1 Processor -- start 2024-09-12T02:34:36.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.971+0000 7f041e99f640 1 -- start start 2024-09-12T02:34:36.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f041809af70 0x7f04180c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f041815e630 0x7f041815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04180ccd30 con 0x7f041815e250 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04180cd920 con 0x7f041809af70 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e99f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f041809ba70 con 0x7f041815e630 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50554/0 (socket says 172.21.15.119:50554) 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 -- 172.21.15.119:0/3956131382 learned_addr learned my addr 172.21.15.119:0/3956131382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d99d640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f041809af70 0x7f04180c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041e19e640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f041815e630 0x7f041815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 -- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f041815e630 msgr2=0x7f041815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f041815e630 0x7f041815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 -- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f041809af70 msgr2=0x7f04180c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f041809af70 0x7f04180c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 -- 172.21.15.119:0/3956131382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180c9750 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f041d19c640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f040800d800 tx=0x7f040800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.972+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800b6c0 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.973+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408019070 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.973+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04180c99f0 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.973+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800ba80 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.973+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04180c9fb0 con 0x7f041815e250 2024-09-12T02:34:36.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.974+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041809aa30 con 0x7f041815e250 2024-09-12T02:34:36.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.975+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f040800bc20 con 0x7f041815e250 2024-09-12T02:34:36.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.975+0000 7f040e7fc640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 0x7f03fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:36.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.975+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f040808b480 con 0x7f041815e250 2024-09-12T02:34:36.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.975+0000 7f041d99d640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 0x7f03fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:36.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.976+0000 7f041d99d640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 0x7f03fc06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04180cc1e0 tx=0x7f0414009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:36.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:36.980+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0408059530 con 0x7f041815e250 2024-09-12T02:34:37.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.150+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f04180b1100 con 0x7f041815e250 2024-09-12T02:34:37.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.151+0000 7f040e7fc640 1 -- 172.21.15.119:0/3956131382 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f040805d830 con 0x7f041815e250 2024-09-12T02:34:37.152 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 msgr2=0x7f03fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 0x7f03fc06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04180cc1e0 tx=0x7f0414009060 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 msgr2=0x7f041815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f040800d800 tx=0x7f040800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 shutdown_connections 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f03fc06be30 0x7f03fc06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f041815e630 0x7f041815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f041815e250 0x7f041815b860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 --2- 172.21.15.119:0/3956131382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f041809af70 0x7f04180c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 >> 172.21.15.119:0/3956131382 conn(0x7f04180d2140 msgr2=0x7f04180b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 shutdown_connections 2024-09-12T02:34:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.153+0000 7f041e99f640 1 -- 172.21.15.119:0/3956131382 wait complete. 2024-09-12T02:34:37.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-09-12T02:34:37.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 Processor -- start 2024-09-12T02:34:37.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 -- start start 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 0x7f58c00b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c00cec00 con 0x7f58c00d0980 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f58c009bd90 con 0x7f58c00b1620 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.264+0000 7f58c6dbd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58c00d0010 con 0x7f58c015c520 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58bffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 0x7f58c00b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:53712/0 (socket says 172.21.15.119:53712) 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58bffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 0x7f58c00b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:51362/0 (socket says 172.21.15.119:51362) 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 -- 172.21.15.119:0/924691694 learned_addr learned my addr 172.21.15.119:0/924691694 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 -- 172.21.15.119:0/924691694 >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 msgr2=0x7f58c00b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 --2- 172.21.15.119:0/924691694 >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 0x7f58c00b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 -- 172.21.15.119:0/924691694 >> v1:172.21.15.153:6789/0 conn(0x7f58c00d0980 legacy=0x7f58c00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.265+0000 7f58c4b59640 1 -- 172.21.15.119:0/924691694 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c00d02f0 con 0x7f58c015c520 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.266+0000 7f58c4b59640 1 --2- 172.21.15.119:0/924691694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bb5b2a49cf187c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.266+0000 7f58bf7fe640 1 -- 172.21.15.119:0/924691694 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8037070 con 0x7f58c015c520 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.266+0000 7f58bf7fe640 1 -- 172.21.15.119:0/924691694 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b8032440 con 0x7f58c015c520 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.266+0000 7f58bf7fe640 1 -- 172.21.15.119:0/924691694 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8032810 con 0x7f58c015c520 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 -- 172.21.15.119:0/924691694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 msgr2=0x7f58c009b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/924691694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b802a270 comp rx=0 tx=0).stop 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 -- 172.21.15.119:0/924691694 shutdown_connections 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/924691694 >> v2:172.21.15.153:3300/0 conn(0x7f58c00b1620 0x7f58c00b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/924691694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c015c520 0x7f58c009b720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 -- 172.21.15.119:0/924691694 >> 172.21.15.119:0/924691694 conn(0x7f58c00d23a0 msgr2=0x7f58c00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 -- 172.21.15.119:0/924691694 shutdown_connections 2024-09-12T02:34:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.267+0000 7f58c6dbd640 1 -- 172.21.15.119:0/924691694 wait complete. 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.268+0000 7f58c6dbd640 1 Processor -- start 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.268+0000 7f58c6dbd640 1 -- start start 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c00d0980 0x7f58c00b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 0x7f58c00b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58c015c900 con 0x7f58c00b1620 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58c00d05d0 con 0x7f58c015c520 2024-09-12T02:34:37.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c6dbd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58c00c7450 con 0x7f58c00d0980 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50562/0 (socket says 172.21.15.119:50562) 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 -- 172.21.15.119:0/2887044483 learned_addr learned my addr 172.21.15.119:0/2887044483 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58bffff640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c00d0980 0x7f58c00b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c535a640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 0x7f58c00b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 -- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c00d0980 msgr2=0x7f58c00b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c00d0980 0x7f58c00b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 -- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 msgr2=0x7f58c00b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 0x7f58c00b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c4b59640 1 -- 172.21.15.119:0/2887044483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c00c67d0 con 0x7f58c00b1620 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.269+0000 7f58c535a640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 0x7f58c00b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58c4b59640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f58b80090b0 tx=0x7f58b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8041030 con 0x7f58c00b1620 2024-09-12T02:34:37.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b8030440 con 0x7f58c00b1620 2024-09-12T02:34:37.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8037040 con 0x7f58c00b1620 2024-09-12T02:34:37.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c00c6ab0 con 0x7f58c00b1620 2024-09-12T02:34:37.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.270+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c00c6410 con 0x7f58c00b1620 2024-09-12T02:34:37.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.271+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c00c6fd0 con 0x7f58c00b1620 2024-09-12T02:34:37.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.271+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58b8044070 con 0x7f58c00b1620 2024-09-12T02:34:37.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.272+0000 7f58bd7fa640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 0x7f58a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.272+0000 7f58bffff640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 0x7f58a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.272+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f58b80ab530 con 0x7f58c00b1620 2024-09-12T02:34:37.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.272+0000 7f58bffff640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 0x7f58a006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58c00b7520 tx=0x7f58b000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.276+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58c00c6fd0 con 0x7f58c00b1620 2024-09-12T02:34:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.505+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7f58c00c7220 con 0x7f58c00b1620 2024-09-12T02:34:37.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.737+0000 7f58bd7fa640 1 -- 172.21.15.119:0/2887044483 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v58) ==== 126+0+0 (secure 0 0 0) 0x7f58b804b070 con 0x7f58c00b1620 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 msgr2=0x7f58a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 0x7f58a006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58c00b7520 tx=0x7f58b000b040 comp rx=0 tx=0).stop 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 msgr2=0x7f58c00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f58b80090b0 tx=0x7f58b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 shutdown_connections 2024-09-12T02:34:37.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f58a006be30 0x7f58a006e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c015c520 0x7f58c00b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58c00d0980 0x7f58c00b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 --2- 172.21.15.119:0/2887044483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00b1620 0x7f58c00c5ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 >> 172.21.15.119:0/2887044483 conn(0x7f58c00d23a0 msgr2=0x7f58c00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 shutdown_connections 2024-09-12T02:34:37.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.740+0000 7f58c6dbd640 1 -- 172.21.15.119:0/2887044483 wait complete. 2024-09-12T02:34:37.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:34:37.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.853+0000 7faa7a49b640 1 Processor -- start 2024-09-12T02:34:37.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.853+0000 7faa7a49b640 1 -- start start 2024-09-12T02:34:37.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa740d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa7409ae10 0x7faa7415f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faa7415f850 0x7faa74162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7faa740d17e0 con 0x7faa7415f850 2024-09-12T02:34:37.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faa740d0bd0 con 0x7faa7409ae10 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa7a49b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa740d0eb0 con 0x7faa7409aa30 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa78a38640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faa7415f850 0x7faa74162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa78a38640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faa7415f850 0x7faa74162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50572/0 (socket says 172.21.15.119:50572) 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.854+0000 7faa78a38640 1 -- 172.21.15.119:0/1293808510 learned_addr learned my addr 172.21.15.119:0/1293808510 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 -- 172.21.15.119:0/1293808510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 msgr2=0x7faa740d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 --2- 172.21.15.119:0/1293808510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa740d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 -- 172.21.15.119:0/1293808510 >> v2:172.21.15.153:3300/0 conn(0x7faa7409ae10 msgr2=0x7faa7415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 --2- 172.21.15.119:0/1293808510 >> v2:172.21.15.153:3300/0 conn(0x7faa7409ae10 0x7faa7415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 -- 172.21.15.119:0/1293808510 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740d1190 con 0x7faa7415f850 2024-09-12T02:34:37.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa78a38640 1 --2- 172.21.15.119:0/1293808510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7415f850 0x7faa74162180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa7406e810 tx=0x7faa6c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f508f823eb95f3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.855+0000 7faa72ffd640 1 -- 172.21.15.119:0/1293808510 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c036070 con 0x7faa7415f850 2024-09-12T02:34:37.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa72ffd640 1 -- 172.21.15.119:0/1293808510 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c031600 con 0x7faa7415f850 2024-09-12T02:34:37.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa72ffd640 1 -- 172.21.15.119:0/1293808510 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0319d0 con 0x7faa7415f850 2024-09-12T02:34:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 -- 172.21.15.119:0/1293808510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7415f850 msgr2=0x7faa74162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1293808510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7415f850 0x7faa74162180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa7406e810 tx=0x7faa6c02a730 comp rx=0 tx=0).stop 2024-09-12T02:34:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 -- 172.21.15.119:0/1293808510 shutdown_connections 2024-09-12T02:34:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1293808510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7415f850 0x7faa74162180 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1293808510 >> v2:172.21.15.153:3300/0 conn(0x7faa7409ae10 0x7faa7415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1293808510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa740d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 -- 172.21.15.119:0/1293808510 >> 172.21.15.119:0/1293808510 conn(0x7faa740d2380 msgr2=0x7faa740d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 -- 172.21.15.119:0/1293808510 shutdown_connections 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.856+0000 7faa7a49b640 1 -- 172.21.15.119:0/1293808510 wait complete. 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.857+0000 7faa7a49b640 1 Processor -- start 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.857+0000 7faa7a49b640 1 -- start start 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa7415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7415f850 0x7faa740c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa7409b250 con 0x7faa7409ae10 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa741626c0 con 0x7faa7415f850 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa7a49b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa7415e4d0 con 0x7faa7409aa30 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50588/0 (socket says 172.21.15.119:50588) 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa737fe640 1 -- 172.21.15.119:0/1697392342 learned_addr learned my addr 172.21.15.119:0/1697392342 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa73fff640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa7415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.858+0000 7faa78a38640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7415f850 0x7faa740c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 -- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 msgr2=0x7faa7415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa7415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 -- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7415f850 msgr2=0x7faa740c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7415f850 0x7faa740c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 -- 172.21.15.119:0/1697392342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740c6d40 con 0x7faa7409ae10 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa737fe640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa6800b4a0 tx=0x7faa6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68014070 con 0x7faa7409ae10 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa740c7020 con 0x7faa7409ae10 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa68010610 con 0x7faa7409ae10 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68010a00 con 0x7faa7409ae10 2024-09-12T02:34:37.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.859+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa740c75e0 con 0x7faa7409ae10 2024-09-12T02:34:37.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.860+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7415f310 con 0x7faa7409ae10 2024-09-12T02:34:37.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.860+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa68017070 con 0x7faa7409ae10 2024-09-12T02:34:37.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.861+0000 7faa70ff9640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 0x7faa6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:37.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.861+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faa6808acc0 con 0x7faa7409ae10 2024-09-12T02:34:37.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.861+0000 7faa73fff640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 0x7faa6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:37.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.861+0000 7faa73fff640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 0x7faa6006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa740a0490 tx=0x7faa64008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:37.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:37.865+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa680592b0 con 0x7faa7409ae10 2024-09-12T02:34:38.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.030+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7faa740ce7d0 con 0x7faa7409ae10 2024-09-12T02:34:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.033+0000 7faa70ff9640 1 -- 172.21.15.119:0/1697392342 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7faa68058bb0 con 0x7faa7409ae10 2024-09-12T02:34:38.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 msgr2=0x7faa6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 0x7faa6006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa740a0490 tx=0x7faa64008040 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 msgr2=0x7faa741586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa6800b4a0 tx=0x7faa6800b960 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 shutdown_connections 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7faa6006be30 0x7faa6006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7415f850 0x7faa740c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7409ae10 0x7faa741586c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 --2- 172.21.15.119:0/1697392342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa7409aa30 0x7faa7415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 >> 172.21.15.119:0/1697392342 conn(0x7faa740d2380 msgr2=0x7faa74160840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 shutdown_connections 2024-09-12T02:34:38.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.035+0000 7faa7a49b640 1 -- 172.21.15.119:0/1697392342 wait complete. 2024-09-12T02:34:38.046 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:34:38.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:34:38.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:34:38.135 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:34:38.135 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:38.136 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.151 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:38.151 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.207 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:38.207 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:38.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.402+0000 7fc9f1e47640 1 Processor -- start 2024-09-12T02:34:38.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.402+0000 7fc9f1e47640 1 -- start start 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9f1e47640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc9ec0d1540 0x7fc9ec06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9f1e47640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9ec09b690 0x7fc9ec06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9f1e47640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9ec0d1970 con 0x7fc9ec15e740 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9f1e47640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ec15eb20 con 0x7fc9ec0d1540 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9f1e47640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ec06d260 con 0x7fc9ec09b690 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc9ec15e740 0x7fc9ec06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60504/0 (socket says 172.21.15.119:60504) 2024-09-12T02:34:38.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eb7fe640 1 -- 172.21.15.119:0/3343126136 learned_addr learned my addr 172.21.15.119:0/3343126136 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3343126136 >> v2:172.21.15.119:3300/0 conn(0x7fc9ec0d1540 0x7fc9ec06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9ebfff640 1 --2- 172.21.15.119:0/3343126136 >> v2:172.21.15.153:3300/0 conn(0x7fc9ec09b690 0x7fc9ec06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9ea7fc640 1 -- 172.21.15.119:0/3343126136 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533968872 0 0) 0x7fc9ec0d1970 con 0x7fc9ec15e740 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9ea7fc640 1 -- 172.21.15.119:0/3343126136 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d4003520 con 0x7fc9ec15e740 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3343126136 >> v2:172.21.15.153:3300/0 conn(0x7fc9ec09b690 msgr2=0x7fc9ec06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3343126136 >> v2:172.21.15.153:3300/0 conn(0x7fc9ec09b690 0x7fc9ec06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3343126136 >> v1:172.21.15.119:6789/0 conn(0x7fc9ec15e740 legacy=0x7fc9ec06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.403+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3343126136 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec0d0780 con 0x7fc9ec0d1540 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.404+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3343126136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec06dbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06cba0 tx=0x7fc9e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b76288f86eade74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.404+0000 7fc9ea7fc640 1 -- 172.21.15.119:0/3343126136 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0037070 con 0x7fc9ec0d1540 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.404+0000 7fc9ea7fc640 1 -- 172.21.15.119:0/3343126136 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e0032440 con 0x7fc9ec0d1540 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.404+0000 7fc9ea7fc640 1 -- 172.21.15.119:0/3343126136 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0032810 con 0x7fc9ec0d1540 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3343126136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 msgr2=0x7fc9ec06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3343126136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec06dbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06cba0 tx=0x7fc9e002a230 comp rx=0 tx=0).stop 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3343126136 shutdown_connections 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3343126136 >> v2:172.21.15.153:3300/0 conn(0x7fc9ec09b690 0x7fc9ec06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3343126136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec06dbd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3343126136 >> 172.21.15.119:0/3343126136 conn(0x7fc9ec0d23a0 msgr2=0x7fc9ec0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3343126136 shutdown_connections 2024-09-12T02:34:38.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.405+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3343126136 wait complete. 2024-09-12T02:34:38.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.406+0000 7fc9f1e47640 1 Processor -- start 2024-09-12T02:34:38.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.406+0000 7fc9f1e47640 1 -- start start 2024-09-12T02:34:38.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec09b690 0x7fc9ec0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e740 0x7fc9ec0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec0d1020 con 0x7fc9ec0d1540 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec0d0d40 con 0x7fc9ec09b690 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9f1e47640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ec09baa0 con 0x7fc9ec15e740 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59604/0 (socket says 172.21.15.119:59604) 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3906826651 learned_addr learned my addr 172.21.15.119:0/3906826651 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e740 msgr2=0x7fc9ec0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e740 0x7fc9ec0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec09b690 msgr2=0x7fc9ec0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec09b690 0x7fc9ec0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 -- 172.21.15.119:0/3906826651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec0cbaf0 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.407+0000 7fc9eaffd640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009890 tx=0x7fc9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.408+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0037040 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.408+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e0042070 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.408+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0030960 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.408+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec0c96c0 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.408+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec0c9c80 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.409+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec0c9e80 con 0x7fc9ec0d1540 2024-09-12T02:34:38.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.409+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9e0030b00 con 0x7fc9ec0d1540 2024-09-12T02:34:38.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.410+0000 7fc9d3fff640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 0x7fc9d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.410+0000 7fc9eb7fe640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 0x7fc9d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.410+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc9e00aba40 con 0x7fc9ec0d1540 2024-09-12T02:34:38.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.410+0000 7fc9eb7fe640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 0x7fc9d806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0012e0 tx=0x7fc9dc001650 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.414+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9ec0c9e80 con 0x7fc9ec0d1540 2024-09-12T02:34:38.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.592+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9ec0d1cb0 con 0x7fc9ec0d1540 2024-09-12T02:34:38.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.592+0000 7fc9d3fff640 1 -- 172.21.15.119:0/3906826651 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc9e0045360 con 0x7fc9ec0d1540 2024-09-12T02:34:38.593 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 msgr2=0x7fc9d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 0x7fc9d806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0012e0 tx=0x7fc9dc001650 comp rx=0 tx=0).stop 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 msgr2=0x7fc9ec0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009890 tx=0x7fc9e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 shutdown_connections 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc9d806be30 0x7fc9d806e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e740 0x7fc9ec0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9ec0d1540 0x7fc9ec0b08c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 --2- 172.21.15.119:0/3906826651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec09b690 0x7fc9ec0cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 >> 172.21.15.119:0/3906826651 conn(0x7fc9ec0d23a0 msgr2=0x7fc9ec0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 shutdown_connections 2024-09-12T02:34:38.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.594+0000 7fc9f1e47640 1 -- 172.21.15.119:0/3906826651 wait complete. 2024-09-12T02:34:38.605 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:34:38.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:38.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:34:38.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:34:38.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:38.632 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:34:38.688 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:38.688 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.708 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:38.708 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.768 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:38.768 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:38.827 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:38.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.927+0000 7fbae1318640 1 Processor -- start 2024-09-12T02:34:38.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.927+0000 7fbae1318640 1 -- start start 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbae1318640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbadc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbae1318640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbadc0b64b0 0x7fbadc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbae1318640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbadc06d9f0 con 0x7fbadc161c80 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbae1318640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbadc06dcd0 con 0x7fbadc0b64b0 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbae1318640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc06dfb0 con 0x7fbadc162060 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbadaffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbadc161c80 0x7fbadc06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60506/0 (socket says 172.21.15.119:60506) 2024-09-12T02:34:38.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbadaffd640 1 -- 172.21.15.119:0/2458869729 learned_addr learned my addr 172.21.15.119:0/2458869729 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436865449 0 0) 0x7fbadc06d9f0 con 0x7fbadc161c80 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac4003520 con 0x7fbadc161c80 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbada7fc640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbadc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbadb7fe640 1 --2- 172.21.15.119:0/2458869729 >> v2:172.21.15.153:3300/0 conn(0x7fbadc0b64b0 0x7fbadc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2200138347 0 0) 0x7fbac4003520 con 0x7fbadc161c80 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 msgr2=0x7fbadc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbadc0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 >> v2:172.21.15.153:3300/0 conn(0x7fbadc0b64b0 msgr2=0x7fbadc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 --2- 172.21.15.119:0/2458869729 >> v2:172.21.15.153:3300/0 conn(0x7fbadc0b64b0 0x7fbadc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc0d01f0 con 0x7fbadc161c80 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fbacc001670 con 0x7fbadc161c80 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 >> v1:172.21.15.119:6789/0 conn(0x7fbadc161c80 legacy=0x7fbadc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.928+0000 7fbad9ffb640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40039b0 0x7fbac4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbad9ffb640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbac4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbad9ffb640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4004d40 0x7fbac40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc06dcd0 con 0x7fbac40039b0 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc06dfb0 con 0x7fbac4004d40 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbac400ba70 con 0x7fbadc162060 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40039b0 0x7fbac4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbada7fc640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbac4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadb7fe640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4004d40 0x7fbac40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 -- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 msgr2=0x7fbac4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc162060 0x7fbac4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 -- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4004d40 msgr2=0x7fbac40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4004d40 0x7fbac40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.929+0000 7fbadaffd640 1 -- 172.21.15.119:0/2458869729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac4003520 con 0x7fbac40039b0 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40039b0 0x7fbac4003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c210 tx=0x7fbac4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af30c28b17a81e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc007d70 con 0x7fbac40039b0 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc005af0 con 0x7fbac40039b0 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbad9ffb640 1 -- 172.21.15.119:0/2458869729 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc007070 con 0x7fbac40039b0 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 -- 172.21.15.119:0/2458869729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40039b0 msgr2=0x7fbac4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 --2- 172.21.15.119:0/2458869729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40039b0 0x7fbac4003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c210 tx=0x7fbac4005830 comp rx=0 tx=0).stop 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbadb7fe640 1 -- 172.21.15.119:0/2458869729 reap_dead start 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 -- 172.21.15.119:0/2458869729 shutdown_connections 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 -- 172.21.15.119:0/2458869729 >> 172.21.15.119:0/2458869729 conn(0x7fbadc0d44f0 msgr2=0x7fbadc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 -- 172.21.15.119:0/2458869729 shutdown_connections 2024-09-12T02:34:38.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.930+0000 7fbae1318640 1 -- 172.21.15.119:0/2458869729 wait complete. 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 Processor -- start 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 -- start start 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 0x7fbadc155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 0x7fbadc15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc0b5f70 con 0x7fbadc159610 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc0d2aa0 con 0x7fbac40039b0 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.932+0000 7fbae1318640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc0b60f0 con 0x7fbadc15dbe0 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59628/0 (socket says 172.21.15.119:59628) 2024-09-12T02:34:38.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 -- 172.21.15.119:0/2688169243 learned_addr learned my addr 172.21.15.119:0/2688169243 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 0x7fbadc155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbadb7fe640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 0x7fbadc15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 -- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 msgr2=0x7fbadc15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 0x7fbadc15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 -- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 msgr2=0x7fbadc155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 0x7fbadc155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 -- 172.21.15.119:0/2688169243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc0cd9a0 con 0x7fbadc159610 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 0x7fbadc155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbadb7fe640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 0x7fbadc15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbada7fc640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbad00108f0 tx=0x7fbad0010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad001a020 con 0x7fbadc159610 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad000e9c0 con 0x7fbadc159610 2024-09-12T02:34:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc0cdc40 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad000ed90 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.933+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc0ce200 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.934+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbadc0ce5e0 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.935+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbad001d020 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.935+0000 7fbac37fe640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 0x7fbac806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.935+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbad008ba80 con 0x7fbadc159610 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.935+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 0x7fbac806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.935+0000 7fbadaffd640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 0x7fbac806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbacc033000 tx=0x7fbacc009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:38.939+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbadc0ce5e0 con 0x7fbadc159610 2024-09-12T02:34:39.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.116+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbadc0746d0 con 0x7fbadc159610 2024-09-12T02:34:39.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.117+0000 7fbac37fe640 1 -- 172.21.15.119:0/2688169243 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fbadc0746d0 con 0x7fbadc159610 2024-09-12T02:34:39.117 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:39.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 msgr2=0x7fbac806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 0x7fbac806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbacc033000 tx=0x7fbacc009030 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 msgr2=0x7fbadc159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbad00108f0 tx=0x7fbad0010db0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 shutdown_connections 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbac806be60 0x7fbac806e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbadc15dbe0 0x7fbadc15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbadc159610 0x7fbadc159a50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 --2- 172.21.15.119:0/2688169243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40039b0 0x7fbadc155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.118+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 >> 172.21.15.119:0/2688169243 conn(0x7fbadc0d44f0 msgr2=0x7fbadc156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.119+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 shutdown_connections 2024-09-12T02:34:39.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.119+0000 7fbae1318640 1 -- 172.21.15.119:0/2688169243 wait complete. 2024-09-12T02:34:39.130 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:34:39.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:39.130 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-12T02:34:39.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:34:39.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:39.161 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:34:39.233 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:39.233 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.249 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:39.249 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.305 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:34:39.306 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.362 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.500+0000 7fd5ee10c640 1 Processor -- start 2024-09-12T02:34:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5ee10c640 1 -- start start 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5ee10c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd5e815c520 0x7fd5e809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5ee10c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e80cec00 con 0x7fd5e80b1620 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5ee10c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e809bd90 con 0x7fd5e80d1090 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5ee10c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e80d0010 con 0x7fd5e815c520 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.501+0000 7fd5e6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd5e80b1620 0x7fd5e80d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60508/0 (socket says 172.21.15.119:60508) 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e6ffd640 1 -- 172.21.15.119:0/2907230130 learned_addr learned my addr 172.21.15.119:0/2907230130 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744906681 0 0) 0x7fd5e80cec00 con 0x7fd5e80b1620 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/2907230130 >> v2:172.21.15.153:3300/0 conn(0x7fd5e815c520 0x7fd5e809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d0003520 con 0x7fd5e80b1620 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3301560780 0 0) 0x7fd5d0003520 con 0x7fd5e80b1620 2024-09-12T02:34:39.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 >> v2:172.21.15.153:3300/0 conn(0x7fd5e815c520 msgr2=0x7fd5e809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 --2- 172.21.15.119:0/2907230130 >> v2:172.21.15.153:3300/0 conn(0x7fd5e815c520 0x7fd5e809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 >> v1:172.21.15.153:6789/0 conn(0x7fd5e80d1090 legacy=0x7fd5e80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e80d02f0 con 0x7fd5e80b1620 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fd5dc001670 con 0x7fd5e80b1620 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 >> v1:172.21.15.119:6789/0 conn(0x7fd5e80b1620 legacy=0x7fd5e80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d0004800 0x7fd5d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5d00051c0 0x7fd5d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d0010 con 0x7fd5d00039b0 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d000c060 con 0x7fd5d0004800 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d000c260 con 0x7fd5d00051c0 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e6ffd640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d0004800 0x7fd5d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e7fff640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5d00051c0 0x7fd5d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 -- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5d00051c0 msgr2=0x7fd5d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5d00051c0 0x7fd5d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 -- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d0004800 msgr2=0x7fd5d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d0004800 0x7fd5d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e7fff640 1 -- 172.21.15.119:0/2907230130 reap_dead start 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e77fe640 1 -- 172.21.15.119:0/2907230130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d0003520 con 0x7fd5d00039b0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.502+0000 7fd5e6ffd640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d0004800 0x7fd5d0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.503+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5d0003dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009ac0 tx=0x7fd5d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107cf7f1b70092df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.503+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8036070 con 0x7fd5d00039b0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.503+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8031400 con 0x7fd5d00039b0 2024-09-12T02:34:39.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.503+0000 7fd5e67fc640 1 -- 172.21.15.119:0/2907230130 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8009690 con 0x7fd5d00039b0 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 -- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 msgr2=0x7fd5d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5d0003dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009ac0 tx=0x7fd5d0005830 comp rx=0 tx=0).stop 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 -- 172.21.15.119:0/2907230130 shutdown_connections 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/2907230130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5d0003dd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 -- 172.21.15.119:0/2907230130 >> 172.21.15.119:0/2907230130 conn(0x7fd5e80d23a0 msgr2=0x7fd5e80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 -- 172.21.15.119:0/2907230130 shutdown_connections 2024-09-12T02:34:39.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.504+0000 7fd5ee10c640 1 -- 172.21.15.119:0/2907230130 wait complete. 2024-09-12T02:34:39.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.505+0000 7fd5ee10c640 1 Processor -- start 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.505+0000 7fd5ee10c640 1 -- start start 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5e81f5260 0x7fd5e81f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5e80b7e30 0x7fd5e81f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e815c900 con 0x7fd5d00039b0 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d05d0 con 0x7fd5e80b7e30 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5ee10c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e81e9a10 con 0x7fd5e81f5260 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59642/0 (socket says 172.21.15.119:59642) 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 -- 172.21.15.119:0/1732895552 learned_addr learned my addr 172.21.15.119:0/1732895552 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e7fff640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5e80b7e30 0x7fd5e81f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e6ffd640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5e81f5260 0x7fd5e81f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 -- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5e81f5260 msgr2=0x7fd5e81f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5e81f5260 0x7fd5e81f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 -- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5e80b7e30 msgr2=0x7fd5e81f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5e80b7e30 0x7fd5e81f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.506+0000 7fd5e77fe640 1 -- 172.21.15.119:0/1732895552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e80b7070 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5e77fe640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009be0 tx=0x7fd5d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d803f020 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8037040 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e80b7350 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8036070 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.507+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e80b7910 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.508+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e809aea0 con 0x7fd5d00039b0 2024-09-12T02:34:39.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.508+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5d8042020 con 0x7fd5d00039b0 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.509+0000 7fd5cffff640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.509+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd5d80ab0a0 con 0x7fd5d00039b0 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.509+0000 7fd5e6ffd640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.509+0000 7fd5e6ffd640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 0x7fd5d406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc001cc0 tx=0x7fd5dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.513+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5e809aea0 con 0x7fd5d00039b0 2024-09-12T02:34:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.689+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5e809b720 con 0x7fd5d00039b0 2024-09-12T02:34:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.689+0000 7fd5cffff640 1 -- 172.21.15.119:0/1732895552 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd5d8049030 con 0x7fd5d00039b0 2024-09-12T02:34:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:39.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 msgr2=0x7fd5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 0x7fd5d406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc001cc0 tx=0x7fd5dc009040 comp rx=0 tx=0).stop 2024-09-12T02:34:39.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 msgr2=0x7fd5e81e94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009be0 tx=0x7fd5d8004730 comp rx=0 tx=0).stop 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 shutdown_connections 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5e80b7e30 0x7fd5e81f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5e81f5260 0x7fd5e81f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 --2- 172.21.15.119:0/1732895552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5d00039b0 0x7fd5e81e94d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.691+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 >> 172.21.15.119:0/1732895552 conn(0x7fd5e80d23a0 msgr2=0x7fd5e80701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.692+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 shutdown_connections 2024-09-12T02:34:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:39.692+0000 7fd5ee10c640 1 -- 172.21.15.119:0/1732895552 wait complete. 2024-09-12T02:34:39.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-12T02:34:39.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:39.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-12T02:34:39.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:34:39.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:39.729 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:34:39.786 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:39.786 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.805 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:39.805 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.864 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:34:39.864 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:39.922 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:34:40.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.021+0000 7f1baf28d640 1 Processor -- start 2024-09-12T02:34:40.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.021+0000 7f1baf28d640 1 -- start start 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba815c520 0x7f1ba809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ba80b1620 0x7f1ba80b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ba80d0980 0x7f1ba80d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba80cec00 con 0x7f1ba80b1620 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba809bd90 con 0x7f1ba80d0980 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1baf28d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba80d0010 con 0x7f1ba815c520 2024-09-12T02:34:40.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1bac828640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ba80b1620 0x7f1ba80b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1bac828640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ba80b1620 0x7f1ba80b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59650/0 (socket says 172.21.15.119:59650) 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.022+0000 7f1bac828640 1 -- 172.21.15.119:0/1584944313 learned_addr learned my addr 172.21.15.119:0/1584944313 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 -- 172.21.15.119:0/1584944313 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba815c520 msgr2=0x7f1ba809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 --2- 172.21.15.119:0/1584944313 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba815c520 0x7f1ba809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 -- 172.21.15.119:0/1584944313 >> v2:172.21.15.153:3300/0 conn(0x7f1ba80d0980 msgr2=0x7f1ba80d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 --2- 172.21.15.119:0/1584944313 >> v2:172.21.15.153:3300/0 conn(0x7f1ba80d0980 0x7f1ba80d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 -- 172.21.15.119:0/1584944313 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba80d02f0 con 0x7f1ba80b1620 2024-09-12T02:34:40.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1bac828640 1 --2- 172.21.15.119:0/1584944313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba80b1620 0x7f1ba80b1d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80b3ea0 tx=0x7f1b9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25b86f244858bae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.023+0000 7f1ba7fff640 1 -- 172.21.15.119:0/1584944313 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c037070 con 0x7f1ba80b1620 2024-09-12T02:34:40.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1ba7fff640 1 -- 172.21.15.119:0/1584944313 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c032440 con 0x7f1ba80b1620 2024-09-12T02:34:40.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1ba7fff640 1 -- 172.21.15.119:0/1584944313 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c032810 con 0x7f1ba80b1620 2024-09-12T02:34:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 -- 172.21.15.119:0/1584944313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba80b1620 msgr2=0x7f1ba80b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1584944313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba80b1620 0x7f1ba80b1d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80b3ea0 tx=0x7f1b9c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 -- 172.21.15.119:0/1584944313 shutdown_connections 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1584944313 >> v2:172.21.15.153:3300/0 conn(0x7f1ba80d0980 0x7f1ba80d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1584944313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba80b1620 0x7f1ba80b1d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1584944313 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba815c520 0x7f1ba809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 -- 172.21.15.119:0/1584944313 >> 172.21.15.119:0/1584944313 conn(0x7f1ba80d23a0 msgr2=0x7f1ba80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 -- 172.21.15.119:0/1584944313 shutdown_connections 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.024+0000 7f1baf28d640 1 -- 172.21.15.119:0/1584944313 wait complete. 2024-09-12T02:34:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.025+0000 7f1baf28d640 1 Processor -- start 2024-09-12T02:34:40.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.025+0000 7f1baf28d640 1 -- start start 2024-09-12T02:34:40.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba80b1620 0x7f1ba8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ba80d0980 0x7f1ba80b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba815c900 con 0x7f1ba815c520 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba80d05d0 con 0x7f1ba80d0980 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1baf28d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba80b7050 con 0x7f1ba80b1620 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59654/0 (socket says 172.21.15.119:59654) 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 -- 172.21.15.119:0/1614733027 learned_addr learned my addr 172.21.15.119:0/1614733027 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:40.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 -- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba80b1620 msgr2=0x7f1ba8152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba80b1620 0x7f1ba8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 -- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ba80d0980 msgr2=0x7f1ba80b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ba80d0980 0x7f1ba80b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.026+0000 7f1bad82a640 1 -- 172.21.15.119:0/1614733027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba80b6440 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1bad82a640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b970 tx=0x7f1ba000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0019070 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba000cb60 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0014440 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba80b6720 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.027+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba80b6ce0 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.028+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba80b1d40 con 0x7f1ba815c520 2024-09-12T02:34:40.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.028+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ba001c070 con 0x7f1ba815c520 2024-09-12T02:34:40.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.029+0000 7f1ba5ffb640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 0x7f1b9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.029+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1ba008af20 con 0x7f1ba815c520 2024-09-12T02:34:40.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.029+0000 7f1bad029640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 0x7f1b9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.029+0000 7f1bad029640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 0x7f1b9406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009710 tx=0x7f1b98006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.033+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ba0059590 con 0x7f1ba815c520 2024-09-12T02:34:40.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.210+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ba80b8320 con 0x7f1ba815c520 2024-09-12T02:34:40.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.210+0000 7f1ba5ffb640 1 -- 172.21.15.119:0/1614733027 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f1ba0058e90 con 0x7f1ba815c520 2024-09-12T02:34:40.211 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:34:40.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 msgr2=0x7f1b9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 0x7f1b9406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009710 tx=0x7f1b98006c90 comp rx=0 tx=0).stop 2024-09-12T02:34:40.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 msgr2=0x7f1ba80cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b970 tx=0x7f1ba000be30 comp rx=0 tx=0).stop 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 shutdown_connections 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1b9406be30 0x7f1b9406e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.212+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ba815c520 0x7f1ba80cc150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.213+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ba80d0980 0x7f1ba80b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.213+0000 7f1baf28d640 1 --2- 172.21.15.119:0/1614733027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ba80b1620 0x7f1ba8152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.213+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 >> 172.21.15.119:0/1614733027 conn(0x7f1ba80d23a0 msgr2=0x7f1ba81e3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.213+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 shutdown_connections 2024-09-12T02:34:40.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.213+0000 7f1baf28d640 1 -- 172.21.15.119:0/1614733027 wait complete. 2024-09-12T02:34:40.224 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-12T02:34:40.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:40.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-12T02:34:40.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:34:40.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:40.256 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:34:40.314 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:34:40.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:40.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.412+0000 7fef520e4640 1 Processor -- start 2024-09-12T02:34:40.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.412+0000 7fef520e4640 1 -- start start 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef520e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef4c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef520e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c06e040 con 0x7fef4c09b690 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef520e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c0d0780 con 0x7fef4c06dbd0 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef520e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c15eb20 con 0x7fef4c15e740 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fef4c09b690 0x7fef4c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60514/0 (socket says 172.21.15.119:60514) 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4affd640 1 -- 172.21.15.119:0/3591068446 learned_addr learned my addr 172.21.15.119:0/3591068446 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4b7fe640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef4c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092978976 0 0) 0x7fef4c06e040 con 0x7fef4c09b690 2024-09-12T02:34:40.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef34003520 con 0x7fef4c09b690 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2523695471 0 0) 0x7fef34003520 con 0x7fef4c09b690 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 msgr2=0x7fef4c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef4c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 >> v1:172.21.15.153:6789/0 conn(0x7fef4c06dbd0 legacy=0x7fef4c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c0d0a60 con 0x7fef4c09b690 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.413+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fef40001670 con 0x7fef4c09b690 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 >> v1:172.21.15.119:6789/0 conn(0x7fef4c09b690 legacy=0x7fef4c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef340039e0 0x7fef34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef34004d40 0x7fef340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c15eb20 con 0x7fef34004d40 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400b9c0 con 0x7fef340039e0 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fef3400bbc0 con 0x7fef4c15e740 2024-09-12T02:34:40.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef34004d40 0x7fef340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4b7fe640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef340039e0 0x7fef34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4affd640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 -- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 msgr2=0x7fef34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 -- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef340039e0 msgr2=0x7fef34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef340039e0 0x7fef34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4bfff640 1 -- 172.21.15.119:0/3591068446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef34003520 con 0x7fef34004d40 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.414+0000 7fef4affd640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15e740 0x7fef34004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef4bfff640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef34004d40 0x7fef340051c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef44002010 tx=0x7fef34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e3caf79ab6afb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44036070 con 0x7fef34004d40 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44031600 con 0x7fef34004d40 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef4a7fc640 1 -- 172.21.15.119:0/3591068446 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44001be0 con 0x7fef34004d40 2024-09-12T02:34:40.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 -- 172.21.15.119:0/3591068446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef34004d40 msgr2=0x7fef340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 --2- 172.21.15.119:0/3591068446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef34004d40 0x7fef340051c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef44002010 tx=0x7fef34005830 comp rx=0 tx=0).stop 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef4bfff640 1 -- 172.21.15.119:0/3591068446 reap_dead start 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 -- 172.21.15.119:0/3591068446 shutdown_connections 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 -- 172.21.15.119:0/3591068446 >> 172.21.15.119:0/3591068446 conn(0x7fef4c0d23a0 msgr2=0x7fef4c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 -- 172.21.15.119:0/3591068446 shutdown_connections 2024-09-12T02:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.415+0000 7fef520e4640 1 -- 172.21.15.119:0/3591068446 wait complete. 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.417+0000 7fef520e4640 1 Processor -- start 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.417+0000 7fef520e4640 1 -- start start 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.417+0000 7fef520e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef34004d40 0x7fef4c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.417+0000 7fef520e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15d990 0x7fef4c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c09ba90 con 0x7fef4c0cb950 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0d1020 con 0x7fef34004d40 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0d1540 con 0x7fef4c15d990 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59660/0 (socket says 172.21.15.119:59660) 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 -- 172.21.15.119:0/1879069730 learned_addr learned my addr 172.21.15.119:0/1879069730 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4affd640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15d990 0x7fef4c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4b7fe640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef34004d40 0x7fef4c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 -- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15d990 msgr2=0x7fef4c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15d990 0x7fef4c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 -- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef34004d40 msgr2=0x7fef4c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef34004d40 0x7fef4c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 -- 172.21.15.119:0/1879069730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c0c8890 con 0x7fef4c0cb950 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef4bfff640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fef4402aab0 tx=0x7fef44001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44042070 con 0x7fef4c0cb950 2024-09-12T02:34:40.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44003970 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44036040 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c0ca4d0 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.418+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c0c7ad0 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.419+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c0d0780 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.420+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef44045070 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.420+0000 7fef33fff640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 0x7fef3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.421+0000 7fef4b7fe640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 0x7fef3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.421+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fef440aa920 con 0x7fef4c0cb950 2024-09-12T02:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.421+0000 7fef4b7fe640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 0x7fef3806e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009bc0 tx=0x7fef3c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.425+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef440789d0 con 0x7fef4c0cb950 2024-09-12T02:34:40.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.623+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef4c0d1cb0 con 0x7fef4c0cb950 2024-09-12T02:34:40.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.623+0000 7fef33fff640 1 -- 172.21.15.119:0/1879069730 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fef4407ccd0 con 0x7fef4c0cb950 2024-09-12T02:34:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:40.624 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 msgr2=0x7fef3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 0x7fef3806e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009bc0 tx=0x7fef3c009190 comp rx=0 tx=0).stop 2024-09-12T02:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 msgr2=0x7fef4c0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fef4402aab0 tx=0x7fef44001630 comp rx=0 tx=0).stop 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 shutdown_connections 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fef3806be60 0x7fef3806e320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef4c0cb950 0x7fef4c0cbdd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef4c15d990 0x7fef4c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 --2- 172.21.15.119:0/1879069730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef34004d40 0x7fef4c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.625+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 >> 172.21.15.119:0/1879069730 conn(0x7fef4c0d23a0 msgr2=0x7fef4c0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.626+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 shutdown_connections 2024-09-12T02:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.626+0000 7fef520e4640 1 -- 172.21.15.119:0/1879069730 wait complete. 2024-09-12T02:34:40.637 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.735+0000 7fb4216e4640 1 Processor -- start 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.735+0000 7fb4216e4640 1 -- start start 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c15c520 0x7fb41c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb41c0b1620 0x7fb41c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 0x7fb41c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb41c0cec00 con 0x7fb41c0b1620 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb41c09bd90 con 0x7fb41c0d0980 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb4216e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c0d0010 con 0x7fb41c15c520 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb41a7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb41c0b1620 0x7fb41c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.736+0000 7fb41a7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb41c0b1620 0x7fb41c0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59670/0 (socket says 172.21.15.119:59670) 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 -- 172.21.15.119:0/1360283614 learned_addr learned my addr 172.21.15.119:0/1360283614 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41affd640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c15c520 0x7fb41c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41b7fe640 1 --2- 172.21.15.119:0/1360283614 >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 0x7fb41c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 -- 172.21.15.119:0/1360283614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c15c520 msgr2=0x7fb41c09b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c15c520 0x7fb41c09b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 -- 172.21.15.119:0/1360283614 >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 msgr2=0x7fb41c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/1360283614 >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 0x7fb41c0d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41a7fc640 1 -- 172.21.15.119:0/1360283614 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c0d02f0 con 0x7fb41c0b1620 2024-09-12T02:34:40.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.737+0000 7fb41b7fe640 1 --2- 172.21.15.119:0/1360283614 >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 0x7fb41c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:40.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c0b1d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0b3ea0 tx=0x7fb41002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec17da8273e5d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb419ffb640 1 -- 172.21.15.119:0/1360283614 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410037070 con 0x7fb41c0b1620 2024-09-12T02:34:40.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb419ffb640 1 -- 172.21.15.119:0/1360283614 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410032440 con 0x7fb41c0b1620 2024-09-12T02:34:40.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb419ffb640 1 -- 172.21.15.119:0/1360283614 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410032810 con 0x7fb41c0b1620 2024-09-12T02:34:40.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 -- 172.21.15.119:0/1360283614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 msgr2=0x7fb41c0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c0b1d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0b3ea0 tx=0x7fb41002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 -- 172.21.15.119:0/1360283614 shutdown_connections 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 --2- 172.21.15.119:0/1360283614 >> v2:172.21.15.153:3300/0 conn(0x7fb41c0d0980 0x7fb41c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c0b1d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 --2- 172.21.15.119:0/1360283614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c15c520 0x7fb41c09b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 -- 172.21.15.119:0/1360283614 >> 172.21.15.119:0/1360283614 conn(0x7fb41c0d23a0 msgr2=0x7fb41c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.738+0000 7fb4216e4640 1 -- 172.21.15.119:0/1360283614 shutdown_connections 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.739+0000 7fb4216e4640 1 -- 172.21.15.119:0/1360283614 wait complete. 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.740+0000 7fb4216e4640 1 Processor -- start 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.740+0000 7fb4216e4640 1 -- start start 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c0d0980 0x7fb41c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 0x7fb41c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c15c900 con 0x7fb41c0b1620 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c0d05d0 con 0x7fb41c15c520 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c14fce0 con 0x7fb41c0d0980 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59684/0 (socket says 172.21.15.119:59684) 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 -- 172.21.15.119:0/357079813 learned_addr learned my addr 172.21.15.119:0/357079813 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c0d0980 0x7fb41c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41b7fe640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 0x7fb41c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 -- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c0d0980 msgr2=0x7fb41c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c0d0980 0x7fb41c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 -- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 msgr2=0x7fb41c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 0x7fb41c0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 -- 172.21.15.119:0/357079813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c0cc500 con 0x7fb41c0b1620 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41b7fe640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 0x7fb41c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb41affd640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e9b0 tx=0x7fb40c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c017070 con 0x7fb41c0b1620 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c00c9a0 con 0x7fb41c0b1620 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c0cc7a0 con 0x7fb41c0b1620 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.741+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00cd90 con 0x7fb41c0b1620 2024-09-12T02:34:40.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.742+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c15bb20 con 0x7fb41c0b1620 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.743+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c0b1d40 con 0x7fb41c0b1620 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.743+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb40c01a070 con 0x7fb41c0b1620 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.743+0000 7fb4037fe640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.744+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb40c08b460 con 0x7fb41c0b1620 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.744+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.744+0000 7fb41a7fc640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 0x7fb40806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb410034000 tx=0x7fb41002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.748+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb40c059510 con 0x7fb41c0b1620 2024-09-12T02:34:40.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.947+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb41c0b8320 con 0x7fb41c0b1620 2024-09-12T02:34:40.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.947+0000 7fb4037fe640 1 -- 172.21.15.119:0/357079813 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fb40c05d810 con 0x7fb41c0b1620 2024-09-12T02:34:40.948 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:40.948 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:40.949 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:40.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 msgr2=0x7fb40806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 0x7fb40806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb410034000 tx=0x7fb41002e000 comp rx=0 tx=0).stop 2024-09-12T02:34:40.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 msgr2=0x7fb41c14f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e9b0 tx=0x7fb40c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 shutdown_connections 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb41c15c520 0x7fb41c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb41c0d0980 0x7fb41c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 --2- 172.21.15.119:0/357079813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c0b1620 0x7fb41c14f7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.949+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 >> 172.21.15.119:0/357079813 conn(0x7fb41c0d23a0 msgr2=0x7fb41c0b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.950+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 shutdown_connections 2024-09-12T02:34:40.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:40.950+0000 7fb4216e4640 1 -- 172.21.15.119:0/357079813 wait complete. 2024-09-12T02:34:40.961 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:41.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.059+0000 7f404bfe4640 1 Processor -- start 2024-09-12T02:34:41.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.059+0000 7f404bfe4640 1 -- start start 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f404bfe4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4044162060 0x7f40440b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f404bfe4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f404406d9f0 con 0x7f4044161c80 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f404bfe4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f404406dcd0 con 0x7f40440b64b0 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f404bfe4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f404406dfb0 con 0x7f4044162060 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f4049d80640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4044161c80 0x7f404406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60526/0 (socket says 172.21.15.119:60526) 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f4049d80640 1 -- 172.21.15.119:0/2699208089 learned_addr learned my addr 172.21.15.119:0/2699208089 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.060+0000 7f404957f640 1 --2- 172.21.15.119:0/2699208089 >> v2:172.21.15.153:3300/0 conn(0x7f4044162060 0x7f40440b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547898090 0 0) 0x7f404406d9f0 con 0x7f4044161c80 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4030003520 con 0x7f4044161c80 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 308722779 0 0) 0x7f4030003520 con 0x7f4044161c80 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 >> v2:172.21.15.153:3300/0 conn(0x7f4044162060 msgr2=0x7f40440b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 --2- 172.21.15.119:0/2699208089 >> v2:172.21.15.153:3300/0 conn(0x7f4044162060 0x7f40440b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 >> v1:172.21.15.153:6789/0 conn(0x7f40440b64b0 legacy=0x7f40440cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40440d2890 con 0x7f4044161c80 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f4040001670 con 0x7f4044161c80 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404957f640 1 --2- 172.21.15.119:0/2699208089 >> v2:172.21.15.153:3300/0 conn(0x7f4044162060 0x7f40440b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 >> v1:172.21.15.119:6789/0 conn(0x7f4044161c80 legacy=0x7f404406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300039b0 0x7f4030003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4030004800 0x7f4030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 0x7f403000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f404406dfb0 con 0x7f40300051c0 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f403000c060 con 0x7f40300039b0 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f403000c260 con 0x7f4030004800 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 0x7f403000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f4049d80640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300039b0 0x7f4030003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404957f640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4030004800 0x7f4030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 -- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4030004800 msgr2=0x7f4030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4030004800 0x7f4030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 -- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300039b0 msgr2=0x7f4030003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300039b0 0x7f4030003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.061+0000 7f404a581640 1 -- 172.21.15.119:0/2699208089 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4030003520 con 0x7f40300051c0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.062+0000 7f404a581640 1 -- 172.21.15.119:0/2699208089 reap_dead start 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.062+0000 7f404a581640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 0x7f403000b9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f403c001e50 tx=0x7f4030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ffe720e3422097 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.062+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c001a70 con 0x7f40300051c0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.062+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403c003970 con 0x7f40300051c0 2024-09-12T02:34:41.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.062+0000 7f4048d7e640 1 -- 172.21.15.119:0/2699208089 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c003d60 con 0x7f40300051c0 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 -- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 msgr2=0x7f403000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 0x7f403000b9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f403c001e50 tx=0x7f4030005830 comp rx=0 tx=0).stop 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 -- 172.21.15.119:0/2699208089 shutdown_connections 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 --2- 172.21.15.119:0/2699208089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40300051c0 0x7f403000b9c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 -- 172.21.15.119:0/2699208089 >> 172.21.15.119:0/2699208089 conn(0x7f40440d44f0 msgr2=0x7f40440d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 -- 172.21.15.119:0/2699208089 shutdown_connections 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.063+0000 7f404bfe4640 1 -- 172.21.15.119:0/2699208089 wait complete. 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.064+0000 7f404bfe4640 1 Processor -- start 2024-09-12T02:34:41.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.064+0000 7f404bfe4640 1 -- start start 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300051c0 0x7f404414f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440b8e90 0x7f40440b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40440b6300 con 0x7f404415ea90 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40440b6180 con 0x7f40300051c0 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404bfe4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f40440b6960 con 0x7f40440b8e90 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59690/0 (socket says 172.21.15.119:59690) 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 -- 172.21.15.119:0/1584550096 learned_addr learned my addr 172.21.15.119:0/1584550096 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f4049d80640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300051c0 0x7f404414f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404a581640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440b8e90 0x7f40440b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 -- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440b8e90 msgr2=0x7f40440b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440b8e90 0x7f40440b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 -- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300051c0 msgr2=0x7f404414f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300051c0 0x7f404414f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.065+0000 7f404957f640 1 -- 172.21.15.119:0/1584550096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404415b080 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f404957f640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4034011a30 tx=0x7f4034011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403400fbb0 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403400fd50 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404415b360 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034004270 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.066+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404415b920 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.067+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4044068ea0 con 0x7f404415ea90 2024-09-12T02:34:41.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.067+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4034012040 con 0x7f404415ea90 2024-09-12T02:34:41.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.068+0000 7f403a7fc640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 0x7f402806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.068+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f403408b5b0 con 0x7f404415ea90 2024-09-12T02:34:41.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.068+0000 7f4049d80640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 0x7f402806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.068+0000 7f4049d80640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 0x7f402806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40400017e0 tx=0x7f40400015d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.072+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4044068ea0 con 0x7f404415ea90 2024-09-12T02:34:41.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.241+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40440b6cf0 con 0x7f404415ea90 2024-09-12T02:34:41.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.242+0000 7f403a7fc640 1 -- 172.21.15.119:0/1584550096 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f4034019070 con 0x7f404415ea90 2024-09-12T02:34:41.243 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:41.243 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:07.087369+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 msgr2=0x7f402806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 0x7f402806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40400017e0 tx=0x7f40400015d0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 msgr2=0x7f404415ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4034011a30 tx=0x7f4034011e30 comp rx=0 tx=0).stop 2024-09-12T02:34:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 shutdown_connections 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f402806be30 0x7f402806e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440b8e90 0x7f40440b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f404415ea90 0x7f404415ef10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 --2- 172.21.15.119:0/1584550096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40300051c0 0x7f404414f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 >> 172.21.15.119:0/1584550096 conn(0x7f40440d44f0 msgr2=0x7f40440d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 shutdown_connections 2024-09-12T02:34:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.244+0000 7f404bfe4640 1 -- 172.21.15.119:0/1584550096 wait complete. 2024-09-12T02:34:41.257 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:34:41.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:41.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.355+0000 7ff1c5223640 1 Processor -- start 2024-09-12T02:34:41.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.355+0000 7ff1c5223640 1 -- start start 2024-09-12T02:34:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1c5223640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff1c00d04a0 0x7ff1c00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1c5223640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c006cb30 con 0x7ff1c00ae550 2024-09-12T02:34:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1c5223640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c00d0e50 con 0x7ff1c0147360 2024-09-12T02:34:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1c5223640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c006bfb0 con 0x7ff1c00d04a0 2024-09-12T02:34:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1be59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff1c00d04a0 0x7ff1c00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1bf59e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff1c00ae550 0x7ff1c00ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60532/0 (socket says 172.21.15.119:60532) 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1bf59e640 1 -- 172.21.15.119:0/215422296 learned_addr learned my addr 172.21.15.119:0/215422296 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1be59c640 1 -- 172.21.15.119:0/215422296 >> v1:172.21.15.153:6789/0 conn(0x7ff1c0147360 legacy=0x7ff1c0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1be59c640 1 -- 172.21.15.119:0/215422296 >> v1:172.21.15.119:6789/0 conn(0x7ff1c00ae550 legacy=0x7ff1c00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1be59c640 1 -- 172.21.15.119:0/215422296 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c006c290 con 0x7ff1c00d04a0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.356+0000 7ff1bdd9b640 1 -- 172.21.15.119:0/215422296 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086452116 0 0) 0x7ff1c006cb30 con 0x7ff1c00ae550 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.357+0000 7ff1be59c640 1 --2- 172.21.15.119:0/215422296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c00d0910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40097a0 tx=0x7ff1b402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bac040a0605607 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.357+0000 7ff1bdd9b640 1 -- 172.21.15.119:0/215422296 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4037070 con 0x7ff1c00d04a0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.357+0000 7ff1bdd9b640 1 -- 172.21.15.119:0/215422296 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b402ae50 con 0x7ff1c00d04a0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.357+0000 7ff1bdd9b640 1 -- 172.21.15.119:0/215422296 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4032660 con 0x7ff1c00d04a0 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 -- 172.21.15.119:0/215422296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 msgr2=0x7ff1c00d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 --2- 172.21.15.119:0/215422296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c00d0910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40097a0 tx=0x7ff1b402a140 comp rx=0 tx=0).stop 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 -- 172.21.15.119:0/215422296 shutdown_connections 2024-09-12T02:34:41.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 --2- 172.21.15.119:0/215422296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c00d0910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 -- 172.21.15.119:0/215422296 >> 172.21.15.119:0/215422296 conn(0x7ff1c00b2f40 msgr2=0x7ff1c00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 -- 172.21.15.119:0/215422296 shutdown_connections 2024-09-12T02:34:41.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.358+0000 7ff1c5223640 1 -- 172.21.15.119:0/215422296 wait complete. 2024-09-12T02:34:41.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.359+0000 7ff1c5223640 1 Processor -- start 2024-09-12T02:34:41.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.359+0000 7ff1c5223640 1 -- start start 2024-09-12T02:34:41.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1c00ae550 0x7ff1c0158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0147360 0x7ff1c01f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0070fa0 con 0x7ff1c00d04a0 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c006c850 con 0x7ff1c0147360 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1c5223640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c006bc10 con 0x7ff1c00ae550 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59710/0 (socket says 172.21.15.119:59710) 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 -- 172.21.15.119:0/1190145384 learned_addr learned my addr 172.21.15.119:0/1190145384 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:41.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1bf59e640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0147360 0x7ff1c01f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1bed9d640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1c00ae550 0x7ff1c0158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 -- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1c00ae550 msgr2=0x7ff1c0158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1c00ae550 0x7ff1c0158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 -- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0147360 msgr2=0x7ff1c01f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0147360 0x7ff1c01f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 -- 172.21.15.119:0/1190145384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0158e80 con 0x7ff1c00d04a0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.360+0000 7ff1be59c640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40098c0 tx=0x7ff1b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.361+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4042070 con 0x7ff1c00d04a0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.361+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b403e890 con 0x7ff1c00d04a0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.361+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c01f86d0 con 0x7ff1c00d04a0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.361+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4037040 con 0x7ff1c00d04a0 2024-09-12T02:34:41.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.361+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c015c6a0 con 0x7ff1c00d04a0 2024-09-12T02:34:41.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.362+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c009b120 con 0x7ff1c00d04a0 2024-09-12T02:34:41.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.362+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1b4045070 con 0x7ff1c00d04a0 2024-09-12T02:34:41.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.363+0000 7ff1a77fe640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 0x7ff1ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.363+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff1b40abb30 con 0x7ff1c00d04a0 2024-09-12T02:34:41.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.363+0000 7ff1bed9d640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 0x7ff1ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.363+0000 7ff1bed9d640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 0x7ff1ac06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0006fd0 tx=0x7ff1b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.367+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1c0158e80 con 0x7ff1c00d04a0 2024-09-12T02:34:41.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.566+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1c00702f0 con 0x7ff1c00d04a0 2024-09-12T02:34:41.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.567+0000 7ff1a77fe640 1 -- 172.21.15.119:0/1190145384 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7ff1b407a350 con 0x7ff1c00d04a0 2024-09-12T02:34:41.567 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:41.568 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:41.568 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:41.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 msgr2=0x7ff1ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 0x7ff1ac06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0006fd0 tx=0x7ff1b0008040 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 msgr2=0x7ff1c01f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40098c0 tx=0x7ff1b40046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 shutdown_connections 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7ff1ac06be30 0x7ff1ac06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0147360 0x7ff1c01f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00d04a0 0x7ff1c01f7b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 --2- 172.21.15.119:0/1190145384 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1c00ae550 0x7ff1c0158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 >> 172.21.15.119:0/1190145384 conn(0x7ff1c00b2f40 msgr2=0x7ff1c00b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 shutdown_connections 2024-09-12T02:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.569+0000 7ff1c5223640 1 -- 172.21.15.119:0/1190145384 wait complete. 2024-09-12T02:34:41.580 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:41.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.678+0000 7f5b27b11640 1 Processor -- start 2024-09-12T02:34:41.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.678+0000 7f5b27b11640 1 -- start start 2024-09-12T02:34:41.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b27b11640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b200b3760 0x7f5b200b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b27b11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b200b2790 con 0x7f5b2009aa30 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b27b11640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b200b2a70 con 0x7f5b2006cd20 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b27b11640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5b200d0670 con 0x7f5b200b3760 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b258ad640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5b2009aa30 0x7f5b2009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60536/0 (socket says 172.21.15.119:60536) 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.679+0000 7f5b258ad640 1 -- 172.21.15.119:0/3745489029 learned_addr learned my addr 172.21.15.119:0/3745489029 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b250ac640 1 --2- 172.21.15.119:0/3745489029 >> v2:172.21.15.153:3300/0 conn(0x7f5b200b3760 0x7f5b200b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552513291 0 0) 0x7f5b200b2790 con 0x7f5b2009aa30 2024-09-12T02:34:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0c003520 con 0x7f5b2009aa30 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3833597911 0 0) 0x7f5b0c003520 con 0x7f5b2009aa30 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 >> v2:172.21.15.153:3300/0 conn(0x7f5b200b3760 msgr2=0x7f5b200b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 --2- 172.21.15.119:0/3745489029 >> v2:172.21.15.153:3300/0 conn(0x7f5b200b3760 0x7f5b200b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 >> v1:172.21.15.153:6789/0 conn(0x7f5b2006cd20 legacy=0x7f5b20162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200b2d50 con 0x7f5b2009aa30 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f5b1c001670 con 0x7f5b2009aa30 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 >> v1:172.21.15.119:6789/0 conn(0x7f5b2009aa30 legacy=0x7f5b2009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 0x7f5b0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b0c004800 0x7f5b0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0052e0 0x7f5b0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c00c180 con 0x7f5b0c0039b0 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c00c330 con 0x7f5b0c0052e0 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c00c530 con 0x7f5b0c004800 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 0x7f5b0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b250ac640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b0c004800 0x7f5b0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b260ae640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0052e0 0x7f5b0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 -- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b0c004800 msgr2=0x7f5b0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b0c004800 0x7f5b0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 -- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0052e0 msgr2=0x7f5b0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0052e0 0x7f5b0c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b260ae640 1 -- 172.21.15.119:0/3745489029 reap_dead start 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.680+0000 7f5b258ad640 1 -- 172.21.15.119:0/3745489029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c003520 con 0x7f5b0c0039b0 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.681+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 0x7f5b0c003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c001eb0 tx=0x7f5b0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaccaad1face2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.681+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c007d30 con 0x7f5b0c0039b0 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.681+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0058d0 con 0x7f5b0c0039b0 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.681+0000 7f5b248ab640 1 -- 172.21.15.119:0/3745489029 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c005d20 con 0x7f5b0c0039b0 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 -- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 msgr2=0x7f5b0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 0x7f5b0c003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c001eb0 tx=0x7f5b0c005830 comp rx=0 tx=0).stop 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 -- 172.21.15.119:0/3745489029 shutdown_connections 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3745489029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b0c0039b0 0x7f5b0c003dd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 -- 172.21.15.119:0/3745489029 >> 172.21.15.119:0/3745489029 conn(0x7f5b200d23a0 msgr2=0x7f5b200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 -- 172.21.15.119:0/3745489029 shutdown_connections 2024-09-12T02:34:41.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.682+0000 7f5b27b11640 1 -- 172.21.15.119:0/3745489029 wait complete. 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.683+0000 7f5b27b11640 1 Processor -- start 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.683+0000 7f5b27b11640 1 -- start start 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 0x7f5b20162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 0x7f5b20151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2015fe20 con 0x7f5b200b7790 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2015fca0 con 0x7f5b0c0039b0 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b27b11640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5b200d1fe0 con 0x7f5b20151400 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59734/0 (socket says 172.21.15.119:59734) 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 -- 172.21.15.119:0/3282463911 learned_addr learned my addr 172.21.15.119:0/3282463911 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:41.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 0x7f5b20162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b260ae640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 0x7f5b20151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 -- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 msgr2=0x7f5b20151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 0x7f5b20151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 -- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 msgr2=0x7f5b20162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 0x7f5b20162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 -- 172.21.15.119:0/3282463911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20151dc0 con 0x7f5b200b7790 2024-09-12T02:34:41.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b260ae640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 0x7f5b20151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 0x7f5b20162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b250ac640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b10011700 tx=0x7f5b10011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000f9c0 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.684+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1000fb60 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.685+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10015460 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.685+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b20153980 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.685+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b20153f40 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.686+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b200b3030 con 0x7f5b200b7790 2024-09-12T02:34:41.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.686+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b10015600 con 0x7f5b200b7790 2024-09-12T02:34:41.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.686+0000 7f5b167fc640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 0x7f5b0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:41.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.687+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 0x7f5b0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:41.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.687+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5b1008ba70 con 0x7f5b200b7790 2024-09-12T02:34:41.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.687+0000 7f5b258ad640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 0x7f5b0406e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c033000 tx=0x7f5b1c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:41.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.691+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b10019030 con 0x7f5b200b7790 2024-09-12T02:34:41.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.897+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b200b3cb0 con 0x7f5b200b7790 2024-09-12T02:34:41.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.897+0000 7f5b167fc640 1 -- 172.21.15.119:0/3282463911 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f5b1005a0e0 con 0x7f5b200b7790 2024-09-12T02:34:41.898 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:41.898 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"btime":"2024-09-12T02:34:20:253267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/857700133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":857700133},{"type":"v1","addr":"172.21.15.119:6836","nonce":857700133}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/773618427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":773618427},{"type":"v1","addr":"172.21.15.153:6834","nonce":773618427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2109152199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2109152199},{"type":"v1","addr":"172.21.15.119:6837","nonce":2109152199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:00.381345+0000","modified":"2024-09-12T02:34:19.586393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/29298975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":29298975},{"type":"v1","addr":"172.21.15.153:6835","nonce":29298975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-09-12T02:34:41.898 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-12T02:34:41.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.899+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 msgr2=0x7f5b0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.899+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 0x7f5b0406e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c033000 tx=0x7f5b1c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.899+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 msgr2=0x7f5b200b7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.899+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b10011700 tx=0x7f5b10011bc0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 shutdown_connections 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5b0406be60 0x7f5b0406e320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b20151400 0x7f5b20151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b200b7790 0x7f5b200b7bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 --2- 172.21.15.119:0/3282463911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b0c0039b0 0x7f5b20162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 >> 172.21.15.119:0/3282463911 conn(0x7f5b200d23a0 msgr2=0x7f5b200b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 shutdown_connections 2024-09-12T02:34:41.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:41.900+0000 7f5b27b11640 1 -- 172.21.15.119:0/3282463911 wait complete. 2024-09-12T02:34:41.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.008+0000 7f4433aae640 1 Processor -- start 2024-09-12T02:34:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.008+0000 7f4433aae640 1 -- start start 2024-09-12T02:34:42.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.009+0000 7f4433aae640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.009+0000 7f4433aae640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.009+0000 7f4433aae640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442c0af720 con 0x7f442c145e00 2024-09-12T02:34:42.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.009+0000 7f4433aae640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f442c1461e0 con 0x7f442c15d460 2024-09-12T02:34:42.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.009+0000 7f4433aae640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f442c0cdf90 con 0x7f442c0d0be0 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f443204b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f443204b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:54886/0 (socket says 172.21.15.119:54886) 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:40168/0 (socket says 172.21.15.119:40168) 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f443204b640 1 -- 172.21.15.119:0/1366678802 learned_addr learned my addr 172.21.15.119:0/1366678802 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 -- 172.21.15.119:0/1366678802 >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 msgr2=0x7f442c0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 --2- 172.21.15.119:0/1366678802 >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 -- 172.21.15.119:0/1366678802 >> v1:172.21.15.153:6789/0 conn(0x7f442c145e00 legacy=0x7f442c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f4431049640 1 -- 172.21.15.119:0/1366678802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c0ce270 con 0x7f442c0d0be0 2024-09-12T02:34:42.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.010+0000 7f443204b640 1 --2- 172.21.15.119:0/1366678802 >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:42.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.011+0000 7f4431049640 1 --2- 172.21.15.119:0/1366678802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097a0 tx=0x7f441c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c46b1c439690a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.011+0000 7f4430848640 1 -- 172.21.15.119:0/1366678802 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c037070 con 0x7f442c0d0be0 2024-09-12T02:34:42.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.011+0000 7f4430848640 1 -- 172.21.15.119:0/1366678802 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c032440 con 0x7f442c0d0be0 2024-09-12T02:34:42.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.011+0000 7f4430848640 1 -- 172.21.15.119:0/1366678802 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c032810 con 0x7f442c0d0be0 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 -- 172.21.15.119:0/1366678802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 msgr2=0x7f442c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 --2- 172.21.15.119:0/1366678802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097a0 tx=0x7f441c02a180 comp rx=0 tx=0).stop 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 -- 172.21.15.119:0/1366678802 shutdown_connections 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 --2- 172.21.15.119:0/1366678802 >> v2:172.21.15.153:3300/0 conn(0x7f442c15d460 0x7f442c0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 --2- 172.21.15.119:0/1366678802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c0d0be0 0x7f442c0cd8a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 -- 172.21.15.119:0/1366678802 >> 172.21.15.119:0/1366678802 conn(0x7f442c0b2f40 msgr2=0x7f442c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 -- 172.21.15.119:0/1366678802 shutdown_connections 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.012+0000 7f4433aae640 1 -- 172.21.15.119:0/1366678802 wait complete. 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.013+0000 7f4433aae640 1 Processor -- start 2024-09-12T02:34:42.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.013+0000 7f4433aae640 1 -- start start 2024-09-12T02:34:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f442c145e00 0x7f442c143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c15d460 0x7f442c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f442c15d8b0 con 0x7f442c0d0be0 2024-09-12T02:34:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f442c0ce830 con 0x7f442c145e00 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f442c0cede0 con 0x7f442c15d460 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59744/0 (socket says 172.21.15.119:59744) 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 -- 172.21.15.119:0/1598383711 learned_addr learned my addr 172.21.15.119:0/1598383711 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443204b640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c15d460 0x7f442c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4431049640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f442c145e00 0x7f442c143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 -- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c15d460 msgr2=0x7f442c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c15d460 0x7f442c140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 -- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f442c145e00 msgr2=0x7f442c143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f442c145e00 0x7f442c143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 -- 172.21.15.119:0/1598383711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c141980 con 0x7f442c0d0be0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f443184a640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f442800c430 tx=0x7f442800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428017070 con 0x7f442c0d0be0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44280052d0 con 0x7f442c0d0be0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c142f70 con 0x7f442c0d0be0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.014+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428003850 con 0x7f442c0d0be0 2024-09-12T02:34:42.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.015+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c143530 con 0x7f442c0d0be0 2024-09-12T02:34:42.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.015+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c0cd8a0 con 0x7f442c0d0be0 2024-09-12T02:34:42.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.016+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f442801a070 con 0x7f442c0d0be0 2024-09-12T02:34:42.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.016+0000 7f44227fc640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 0x7f441006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.016+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6801+0+0 (secure 0 0 0) 0x7f442808a530 con 0x7f442c0d0be0 2024-09-12T02:34:42.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.016+0000 7f4431049640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 0x7f441006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.017+0000 7f4431049640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 0x7f441006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441c034000 tx=0x7f441c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.021+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44280584d0 con 0x7f442c0d0be0 2024-09-12T02:34:42.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.185+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f442c1e8350 con 0x7f442c0d0be0 2024-09-12T02:34:42.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.187+0000 7f44227fc640 1 -- 172.21.15.119:0/1598383711 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19099 (secure 0 0 0) 0x7f442805c7d0 con 0x7f442c0d0be0 2024-09-12T02:34:42.188 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:42.189 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":28,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:41.749264+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:58.198825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:59.356706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:34:03.076745+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2},{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 msgr2=0x7f441006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 0x7f441006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441c034000 tx=0x7f441c02e000 comp rx=0 tx=0).stop 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 msgr2=0x7f442c13df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f442800c430 tx=0x7f442800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 shutdown_connections 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f441006be30 0x7f441006e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f442c15d460 0x7f442c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f442c145e00 0x7f442c143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 --2- 172.21.15.119:0/1598383711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0d0be0 0x7f442c13df80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 >> 172.21.15.119:0/1598383711 conn(0x7f442c0b2f40 msgr2=0x7f442c0b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 shutdown_connections 2024-09-12T02:34:42.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.189+0000 7f4433aae640 1 -- 172.21.15.119:0/1598383711 wait complete. 2024-09-12T02:34:42.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:34:42.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.301+0000 7f0ed3118640 1 Processor -- start 2024-09-12T02:34:42.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.301+0000 7f0ed3118640 1 -- start start 2024-09-12T02:34:42.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed3118640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ecc09b140 0x7f0ecc169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed3118640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc06cec0 con 0x7f0ecc06df60 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed3118640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc06d1a0 con 0x7f0ecc15e5d0 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed3118640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc06dad0 con 0x7f0ecc09b140 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed16b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ecc09b140 0x7f0ecc169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ec3fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0ecc06df60 0x7f0ecc09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60544/0 (socket says 172.21.15.119:60544) 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ed16b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ecc09b140 0x7f0ecc169570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59752/0 (socket says 172.21.15.119:59752) 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.302+0000 7f0ec3fff640 1 -- 172.21.15.119:0/2065426487 learned_addr learned my addr 172.21.15.119:0/2065426487 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ed16b5640 1 -- 172.21.15.119:0/2065426487 >> v1:172.21.15.153:6789/0 conn(0x7f0ecc15e5d0 legacy=0x7f0ecc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:42.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ed16b5640 1 -- 172.21.15.119:0/2065426487 >> v1:172.21.15.119:6789/0 conn(0x7f0ecc06df60 legacy=0x7f0ecc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ed16b5640 1 -- 172.21.15.119:0/2065426487 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc06d480 con 0x7f0ecc09b140 2024-09-12T02:34:42.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ec37fe640 1 -- 172.21.15.119:0/2065426487 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198767209 0 0) 0x7f0ecc06cec0 con 0x7f0ecc06df60 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ed16b5640 1 --2- 172.21.15.119:0/2065426487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc169570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009dc0 tx=0x7f0ec402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cee9f3d38774214 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ec37fe640 1 -- 172.21.15.119:0/2065426487 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007740 con 0x7f0ecc09b140 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ec37fe640 1 -- 172.21.15.119:0/2065426487 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec40078e0 con 0x7f0ecc09b140 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.303+0000 7f0ec37fe640 1 -- 172.21.15.119:0/2065426487 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007cb0 con 0x7f0ecc09b140 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 -- 172.21.15.119:0/2065426487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 msgr2=0x7f0ecc169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 --2- 172.21.15.119:0/2065426487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc169570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009dc0 tx=0x7f0ec402a760 comp rx=0 tx=0).stop 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 -- 172.21.15.119:0/2065426487 shutdown_connections 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 --2- 172.21.15.119:0/2065426487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc169570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 -- 172.21.15.119:0/2065426487 >> 172.21.15.119:0/2065426487 conn(0x7f0ecc0d23a0 msgr2=0x7f0ecc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 -- 172.21.15.119:0/2065426487 shutdown_connections 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.304+0000 7f0ed3118640 1 -- 172.21.15.119:0/2065426487 wait complete. 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.305+0000 7f0ed3118640 1 Processor -- start 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.305+0000 7f0ed3118640 1 -- start start 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ecc06df60 0x7f0ecc159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ecc15e5d0 0x7f0ecc0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0d1980 con 0x7f0ecc09b140 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0d1800 con 0x7f0ecc15e5d0 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed3118640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc15e9b0 con 0x7f0ecc06df60 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59764/0 (socket says 172.21.15.119:59764) 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ec3fff640 1 -- 172.21.15.119:0/3202708098 learned_addr learned my addr 172.21.15.119:0/3202708098 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed16b5640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ecc15e5d0 0x7f0ecc0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.306+0000 7f0ed0eb4640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ecc06df60 0x7f0ecc159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 -- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ecc06df60 msgr2=0x7f0ecc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ecc06df60 0x7f0ecc159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 -- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ecc15e5d0 msgr2=0x7f0ecc0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ecc15e5d0 0x7f0ecc0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 -- 172.21.15.119:0/3202708098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc159790 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec3fff640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c4d0 tx=0x7f0ebc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc018070 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc007500 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc004a20 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc159a70 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.307+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc15a030 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.308+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc09aa30 con 0x7f0ecc09b140 2024-09-12T02:34:42.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.309+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ebc01b070 con 0x7f0ecc09b140 2024-09-12T02:34:42.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.309+0000 7f0ec17fa640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 0x7f0eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.309+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6801+0+0 (secure 0 0 0) 0x7f0ebc08a5a0 con 0x7f0ecc09b140 2024-09-12T02:34:42.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.309+0000 7f0ed0eb4640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 0x7f0eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.309+0000 7f0ed0eb4640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 0x7f0eb806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006fd0 tx=0x7f0ec8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.313+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ebc058b90 con 0x7f0ecc09b140 2024-09-12T02:34:42.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.514+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0ecc0b8320 con 0x7f0ecc09b140 2024-09-12T02:34:42.515 INFO:tasks.ceph.mon.a.smithi119.stderr:2024-09-12T02:34:42.515+0000 7f4dbacdd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:34:42.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.516+0000 7f0ec17fa640 1 -- 172.21.15.119:0/3202708098 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f0ebc058490 con 0x7f0ecc09b140 2024-09-12T02:34:42.517 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:34:42.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 msgr2=0x7f0eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 0x7f0eb806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006fd0 tx=0x7f0ec8008040 comp rx=0 tx=0).stop 2024-09-12T02:34:42.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 msgr2=0x7f0ecc156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c4d0 tx=0x7f0ebc00c990 comp rx=0 tx=0).stop 2024-09-12T02:34:42.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 shutdown_connections 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb806be30 0x7f0eb806e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ecc15e5d0 0x7f0ecc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc09b140 0x7f0ecc156910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 --2- 172.21.15.119:0/3202708098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ecc06df60 0x7f0ecc159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 >> 172.21.15.119:0/3202708098 conn(0x7f0ecc0d23a0 msgr2=0x7f0ecc09b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 shutdown_connections 2024-09-12T02:34:42.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.518+0000 7f0ed3118640 1 -- 172.21.15.119:0/3202708098 wait complete. 2024-09-12T02:34:42.524 INFO:tasks.ceph.mds.d.smithi153.stderr: -4171> 2024-09-12T02:34:06.023+0000 7fae07a69640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:34:42.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:34:42.560 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-12T02:34:42.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.635+0000 7fce6964c640 1 Processor -- start 2024-09-12T02:34:42.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.635+0000 7fce6964c640 1 -- start start 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce6964c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce6406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce6964c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6415ff70 con 0x7fce64162e30 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce6964c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce640d4d10 con 0x7fce640cf280 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce6964c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce6406de90 con 0x7fce64162340 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce637fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fce64162e30 0x7fce640d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60556/0 (socket says 172.21.15.119:60556) 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce637fe640 1 -- 172.21.15.119:0/3538359617 learned_addr learned my addr 172.21.15.119:0/3538359617 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce62ffd640 1 --2- 172.21.15.119:0/3538359617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce6406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109278382 0 0) 0x7fce6415ff70 con 0x7fce64162e30 2024-09-12T02:34:42.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce50003520 con 0x7fce64162e30 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520798888 0 0) 0x7fce640d4d10 con 0x7fce640cf280 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.636+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce6415ff70 con 0x7fce640cf280 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.637+0000 7fce62ffd640 1 -- 172.21.15.119:0/3538359617 >> v1:172.21.15.153:6789/0 conn(0x7fce640cf280 legacy=0x7fce64162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.637+0000 7fce62ffd640 1 -- 172.21.15.119:0/3538359617 >> v1:172.21.15.119:6789/0 conn(0x7fce64162e30 legacy=0x7fce640d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.637+0000 7fce62ffd640 1 -- 172.21.15.119:0/3538359617 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce640d4ff0 con 0x7fce64162340 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.637+0000 7fce62ffd640 1 --2- 172.21.15.119:0/3538359617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce6406d740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce540097d0 tx=0x7fce5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83eeb59649ee923b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.637+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54037070 con 0x7fce64162340 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54032440 con 0x7fce64162340 2024-09-12T02:34:42.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce627fc640 1 -- 172.21.15.119:0/3538359617 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54032810 con 0x7fce64162340 2024-09-12T02:34:42.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 -- 172.21.15.119:0/3538359617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 msgr2=0x7fce6406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 --2- 172.21.15.119:0/3538359617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce6406d740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce540097d0 tx=0x7fce5402a180 comp rx=0 tx=0).stop 2024-09-12T02:34:42.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 -- 172.21.15.119:0/3538359617 shutdown_connections 2024-09-12T02:34:42.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 --2- 172.21.15.119:0/3538359617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce6406d740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 -- 172.21.15.119:0/3538359617 >> 172.21.15.119:0/3538359617 conn(0x7fce6408bfc0 msgr2=0x7fce640d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 -- 172.21.15.119:0/3538359617 shutdown_connections 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.638+0000 7fce6964c640 1 -- 172.21.15.119:0/3538359617 wait complete. 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.639+0000 7fce6964c640 1 Processor -- start 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.639+0000 7fce6964c640 1 -- start start 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce640cf280 0x7fce641e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce640cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce640cf6c0 con 0x7fce64162e30 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce640d52d0 con 0x7fce640cf280 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce6964c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce640d30a0 con 0x7fce64162340 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce637fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce637fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59772/0 (socket says 172.21.15.119:59772) 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce637fe640 1 -- 172.21.15.119:0/2386068087 learned_addr learned my addr 172.21.15.119:0/2386068087 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce62ffd640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce640cf280 0x7fce641e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce5a7fc640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce640cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.640+0000 7fce637fe640 1 -- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 msgr2=0x7fce640cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce637fe640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce640cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce637fe640 1 -- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce640cf280 msgr2=0x7fce641e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce637fe640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce640cf280 0x7fce641e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce637fe640 1 -- 172.21.15.119:0/2386068087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce640b43f0 con 0x7fce64162e30 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce637fe640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00caf0 tx=0x7fce5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c017070 con 0x7fce64162e30 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c00aca0 con 0x7fce64162e30 2024-09-12T02:34:42.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce640cb640 con 0x7fce64162e30 2024-09-12T02:34:42.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c012620 con 0x7fce64162e30 2024-09-12T02:34:42.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.641+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce640cbc00 con 0x7fce64162e30 2024-09-12T02:34:42.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.642+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce640d3500 con 0x7fce64162e30 2024-09-12T02:34:42.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.642+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce5c01a070 con 0x7fce64162e30 2024-09-12T02:34:42.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.643+0000 7fce5bfff640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 0x7fce4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.643+0000 7fce62ffd640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 0x7fce4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.643+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6887+0+0 (secure 0 0 0) 0x7fce5c08af60 con 0x7fce64162e30 2024-09-12T02:34:42.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.643+0000 7fce62ffd640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 0x7fce4406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce54034000 tx=0x7fce5402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.647+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce640b43f0 con 0x7fce64162e30 2024-09-12T02:34:42.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:42.847+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fce6408e640 con 0x7fce64162e30 2024-09-12T02:34:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.518+0000 7fce5bfff640 1 -- 172.21.15.119:0/2386068087 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fce5c058eb0 con 0x7fce64162e30 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 msgr2=0x7fce4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 0x7fce4406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce54034000 tx=0x7fce5402e000 comp rx=0 tx=0).stop 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 msgr2=0x7fce640b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00caf0 tx=0x7fce5c00a060 comp rx=0 tx=0).stop 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 shutdown_connections 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce4406be30 0x7fce4406e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce64162e30 0x7fce640b1f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce64162340 0x7fce640cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 --2- 172.21.15.119:0/2386068087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce640cf280 0x7fce641e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 >> 172.21.15.119:0/2386068087 conn(0x7fce6408bfc0 msgr2=0x7fce64160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 shutdown_connections 2024-09-12T02:34:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.520+0000 7fce6964c640 1 -- 172.21.15.119:0/2386068087 wait complete. 2024-09-12T02:34:43.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:34:43.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.641+0000 7f6b18dfd640 1 Processor -- start 2024-09-12T02:34:43.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.641+0000 7f6b18dfd640 1 -- start start 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b18dfd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b140af210 0x7f6b14070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b18dfd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b14070fb0 0x7f6b1406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b18dfd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1406cdc0 con 0x7f6b1415e7f0 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b18dfd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6b1406d0a0 con 0x7f6b140af210 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b18dfd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1406d380 con 0x7f6b14070fb0 2024-09-12T02:34:43.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b11d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b140af210 0x7f6b14070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b11d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b140af210 0x7f6b14070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59774/0 (socket says 172.21.15.119:59774) 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b11d9b640 1 -- 172.21.15.119:0/4166998097 learned_addr learned my addr 172.21.15.119:0/4166998097 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.642+0000 7f6b12d9d640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b14070fb0 0x7f6b1406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b11d9b640 1 -- 172.21.15.119:0/4166998097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b14070fb0 msgr2=0x7f6b1406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b11d9b640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b14070fb0 0x7f6b1406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b11d9b640 1 -- 172.21.15.119:0/4166998097 >> v1:172.21.15.153:6789/0 conn(0x7f6b1415e7f0 legacy=0x7f6b140b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b11d9b640 1 -- 172.21.15.119:0/4166998097 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1406d660 con 0x7f6b140af210 2024-09-12T02:34:43.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b11d9b640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b140af210 0x7f6b14070a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009870 tx=0x7f6b0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8a4a771a16c613 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:43.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b1159a640 1 -- 172.21.15.119:0/4166998097 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08037070 con 0x7f6b140af210 2024-09-12T02:34:43.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.643+0000 7f6b1159a640 1 -- 172.21.15.119:0/4166998097 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08032440 con 0x7f6b140af210 2024-09-12T02:34:43.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b1159a640 1 -- 172.21.15.119:0/4166998097 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08032810 con 0x7f6b140af210 2024-09-12T02:34:43.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 -- 172.21.15.119:0/4166998097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b140af210 msgr2=0x7f6b14070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b140af210 0x7f6b14070a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009870 tx=0x7f6b0802a270 comp rx=0 tx=0).stop 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 -- 172.21.15.119:0/4166998097 shutdown_connections 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b14070fb0 0x7f6b1406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/4166998097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b140af210 0x7f6b14070a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 -- 172.21.15.119:0/4166998097 >> 172.21.15.119:0/4166998097 conn(0x7f6b140b3f30 msgr2=0x7f6b140b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 -- 172.21.15.119:0/4166998097 shutdown_connections 2024-09-12T02:34:43.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.644+0000 7f6b18dfd640 1 -- 172.21.15.119:0/4166998097 wait complete. 2024-09-12T02:34:43.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.645+0000 7f6b18dfd640 1 Processor -- start 2024-09-12T02:34:43.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.645+0000 7f6b18dfd640 1 -- start start 2024-09-12T02:34:43.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 0x7f6b1415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 0x7f6b140d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b140b60c0 con 0x7f6b1415e7f0 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b140b5f40 con 0x7f6b14070fb0 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b18dfd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1406e3a0 con 0x7f6b140af210 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b12d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b12d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59788/0 (socket says 172.21.15.119:59788) 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b12d9d640 1 -- 172.21.15.119:0/3441367153 learned_addr learned my addr 172.21.15.119:0/3441367153 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b1259c640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 0x7f6b1415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.646+0000 7f6b11d9b640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 0x7f6b140d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 -- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 msgr2=0x7f6b140d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 0x7f6b140d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 -- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 msgr2=0x7f6b1415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:43.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 0x7f6b1415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 -- 172.21.15.119:0/3441367153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1415b310 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b11d9b640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 0x7f6b140d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b1259c640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 0x7f6b1415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b12d9d640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00efc0 tx=0x7f6b0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c018020 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c014480 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1415b5f0 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c014870 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.647+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b140d2020 con 0x7f6b1415e7f0 2024-09-12T02:34:43.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.648+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1406de60 con 0x7f6b1415e7f0 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.648+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0c005d10 con 0x7f6b1415e7f0 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.649+0000 7f6b02ffd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.649+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6887+0+0 (secure 0 0 0) 0x7f6b0c08bdc0 con 0x7f6b1415e7f0 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.649+0000 7f6b1259c640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.649+0000 7f6b1259c640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 0x7f6af406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001660 tx=0x7f6b04009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:43.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.653+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b0c022070 con 0x7f6b1415e7f0 2024-09-12T02:34:43.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:43.820+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b140b0330 con 0x7f6b1415e7f0 2024-09-12T02:34:44.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.774+0000 7f6b02ffd640 1 -- 172.21.15.119:0/3441367153 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7f6b0c010040 con 0x7f6b1415e7f0 2024-09-12T02:34:44.774 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:34:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 msgr2=0x7f6af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 0x7f6af406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001660 tx=0x7f6b04009040 comp rx=0 tx=0).stop 2024-09-12T02:34:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 msgr2=0x7f6b14153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00efc0 tx=0x7f6b0c00c490 comp rx=0 tx=0).stop 2024-09-12T02:34:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 shutdown_connections 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b1415e7f0 0x7f6b14153da0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b140af210 0x7f6b140d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 --2- 172.21.15.119:0/3441367153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b14070fb0 0x7f6b1415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.777+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 >> 172.21.15.119:0/3441367153 conn(0x7f6b140b3f30 msgr2=0x7f6b140af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.778+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 shutdown_connections 2024-09-12T02:34:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.778+0000 7f6b18dfd640 1 -- 172.21.15.119:0/3441367153 wait complete. 2024-09-12T02:34:44.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:34:44.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.902+0000 7fce6d21e640 1 Processor -- start 2024-09-12T02:34:44.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.902+0000 7fce6d21e640 1 -- start start 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce6d21e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce68073d50 0x7fce680af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce6d21e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce6806f4a0 0x7fce6806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce6d21e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680b3bf0 con 0x7fce680b4f60 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce6d21e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fce680afb10 con 0x7fce68073d50 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce6d21e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fce680ae030 con 0x7fce6806f4a0 2024-09-12T02:34:44.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce68073d50 0x7fce680af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce68073d50 0x7fce680af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59798/0 (socket says 172.21.15.119:59798) 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 -- 172.21.15.119:0/1720116559 learned_addr learned my addr 172.21.15.119:0/1720116559 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 -- 172.21.15.119:0/1720116559 >> v2:172.21.15.153:3300/0 conn(0x7fce6806f4a0 msgr2=0x7fce6806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 --2- 172.21.15.119:0/1720116559 >> v2:172.21.15.153:3300/0 conn(0x7fce6806f4a0 0x7fce6806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 -- 172.21.15.119:0/1720116559 >> v1:172.21.15.119:6789/0 conn(0x7fce680b4f60 legacy=0x7fce6815dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:44.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.904+0000 7fce66d9d640 1 -- 172.21.15.119:0/1720116559 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce680b3ed0 con 0x7fce68073d50 2024-09-12T02:34:44.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.905+0000 7fce66d9d640 1 --2- 172.21.15.119:0/1720116559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce68073d50 0x7fce680af0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce680cc540 tx=0x7fce5803b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6c9a0eea3beccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:44.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.906+0000 7fce65d9b640 1 -- 172.21.15.119:0/1720116559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58048070 con 0x7fce68073d50 2024-09-12T02:34:44.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.906+0000 7fce65d9b640 1 -- 172.21.15.119:0/1720116559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58043440 con 0x7fce68073d50 2024-09-12T02:34:44.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.906+0000 7fce65d9b640 1 -- 172.21.15.119:0/1720116559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580437f0 con 0x7fce68073d50 2024-09-12T02:34:44.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.906+0000 7fce6d21e640 1 -- 172.21.15.119:0/1720116559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce68073d50 msgr2=0x7fce680af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.906+0000 7fce6d21e640 1 --2- 172.21.15.119:0/1720116559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce68073d50 0x7fce680af0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce680cc540 tx=0x7fce5803b2d0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 -- 172.21.15.119:0/1720116559 shutdown_connections 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 --2- 172.21.15.119:0/1720116559 >> v2:172.21.15.153:3300/0 conn(0x7fce6806f4a0 0x7fce6806f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 --2- 172.21.15.119:0/1720116559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce68073d50 0x7fce680af0d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 -- 172.21.15.119:0/1720116559 >> 172.21.15.119:0/1720116559 conn(0x7fce68073230 msgr2=0x7fce68073640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 -- 172.21.15.119:0/1720116559 shutdown_connections 2024-09-12T02:34:44.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.907+0000 7fce6d21e640 1 -- 172.21.15.119:0/1720116559 wait complete. 2024-09-12T02:34:44.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.908+0000 7fce6d21e640 1 Processor -- start 2024-09-12T02:34:44.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.908+0000 7fce6d21e640 1 -- start start 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce6806f4a0 0x7fce68156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce68073d50 0x7fce680b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce6815e1c0 con 0x7fce680b4f60 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce680cdc60 con 0x7fce68073d50 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6d21e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce6806fdf0 con 0x7fce6806f4a0 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:44.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59804/0 (socket says 172.21.15.119:59804) 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6759e640 1 -- 172.21.15.119:0/576058740 learned_addr learned my addr 172.21.15.119:0/576058740 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce6659c640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce68073d50 0x7fce680b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.909+0000 7fce66d9d640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce6806f4a0 0x7fce68156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 -- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce6806f4a0 msgr2=0x7fce68156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce6806f4a0 0x7fce68156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 -- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce68073d50 msgr2=0x7fce680b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce68073d50 0x7fce680b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 -- 172.21.15.119:0/576058740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce681f0e70 con 0x7fce680b4f60 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6759e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b970 tx=0x7fce6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60019070 con 0x7fce680b4f60 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce681f00b0 con 0x7fce680b4f60 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6000cb60 con 0x7fce680b4f60 2024-09-12T02:34:44.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60014440 con 0x7fce680b4f60 2024-09-12T02:34:44.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.910+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce681f0670 con 0x7fce680b4f60 2024-09-12T02:34:44.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.911+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce680b46d0 con 0x7fce680b4f60 2024-09-12T02:34:44.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.912+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce6001c070 con 0x7fce680b4f60 2024-09-12T02:34:44.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.912+0000 7fce4f7fe640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 0x7fce5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:44.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.912+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6449+0+0 (secure 0 0 0) 0x7fce6008ae90 con 0x7fce680b4f60 2024-09-12T02:34:44.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.912+0000 7fce66d9d640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 0x7fce5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:44.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.912+0000 7fce66d9d640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 0x7fce5406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce58045000 tx=0x7fce5803f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:44.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:44.916+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce60058e80 con 0x7fce680b4f60 2024-09-12T02:34:45.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.082+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fce680d0ec0 con 0x7fce680b4f60 2024-09-12T02:34:45.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.778+0000 7fce4f7fe640 1 -- 172.21.15.119:0/576058740 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7fce6005d180 con 0x7fce680b4f60 2024-09-12T02:34:45.779 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.782+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 msgr2=0x7fce5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.782+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 0x7fce5406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce58045000 tx=0x7fce5803f000 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.782+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 msgr2=0x7fce680b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.782+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b970 tx=0x7fce6000be30 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 shutdown_connections 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5406be30 0x7fce5406e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce680b4f60 0x7fce680b2260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce68073d50 0x7fce680b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 --2- 172.21.15.119:0/576058740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce6806f4a0 0x7fce68156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 >> 172.21.15.119:0/576058740 conn(0x7fce68073230 msgr2=0x7fce680b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 shutdown_connections 2024-09-12T02:34:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.783+0000 7fce6d21e640 1 -- 172.21.15.119:0/576058740 wait complete. 2024-09-12T02:34:45.798 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T02:34:45.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 Processor -- start 2024-09-12T02:34:45.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 -- start start 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c15e900 0x7f879c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f879c0b4a20 0x7f879c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0b4620 con 0x7f879c072050 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f879c0ce100 con 0x7f879c0b4a20 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.905+0000 7f87a110a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f879c0ce3a0 con 0x7f879c15e900 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f879c0b4a20 0x7f879c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879b59e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f879c072050 0x7f879c0cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60570/0 (socket says 172.21.15.119:60570) 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879b59e640 1 -- 172.21.15.119:0/1845527514 learned_addr learned my addr 172.21.15.119:0/1845527514 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879ad9d640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c15e900 0x7f879c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879a59c640 1 -- 172.21.15.119:0/1845527514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c15e900 msgr2=0x7f879c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879a59c640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c15e900 0x7f879c0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879a59c640 1 -- 172.21.15.119:0/1845527514 >> v1:172.21.15.119:6789/0 conn(0x7f879c072050 legacy=0x7f879c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f8799d9b640 1 -- 172.21.15.119:0/1845527514 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479913757 0 0) 0x7f879c0b4620 con 0x7f879c072050 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.906+0000 7f879a59c640 1 -- 172.21.15.119:0/1845527514 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0ce680 con 0x7f879c0b4a20 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f879a59c640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c0b4a20 0x7f879c0ad020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f878400ba40 tx=0x7f878402c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8caca96939b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f8799d9b640 1 -- 172.21.15.119:0/1845527514 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784031710 con 0x7f879c0b4a20 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f8799d9b640 1 -- 172.21.15.119:0/1845527514 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87840318b0 con 0x7f879c0b4a20 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f8799d9b640 1 -- 172.21.15.119:0/1845527514 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784031c80 con 0x7f879c0b4a20 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 -- 172.21.15.119:0/1845527514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c0b4a20 msgr2=0x7f879c0ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c0b4a20 0x7f879c0ad020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f878400ba40 tx=0x7f878402c7b0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 -- 172.21.15.119:0/1845527514 shutdown_connections 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c0b4a20 0x7f879c0ad020 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 --2- 172.21.15.119:0/1845527514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c15e900 0x7f879c0b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 -- 172.21.15.119:0/1845527514 >> 172.21.15.119:0/1845527514 conn(0x7f879c06bdf0 msgr2=0x7f879c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 -- 172.21.15.119:0/1845527514 shutdown_connections 2024-09-12T02:34:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.907+0000 7f87a110a640 1 -- 172.21.15.119:0/1845527514 wait complete. 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.909+0000 7f87a110a640 1 Processor -- start 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.909+0000 7f87a110a640 1 -- start start 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.909+0000 7f87a110a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b4a20 0x7f879c1f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 0x7f879c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0ad560 con 0x7f879c072050 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0b4e20 con 0x7f879c15e900 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f879c0cf590 con 0x7f879c0b4a20 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59816/0 (socket says 172.21.15.119:59816) 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 -- 172.21.15.119:0/3273001636 learned_addr learned my addr 172.21.15.119:0/3273001636 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:45.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879a59c640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b4a20 0x7f879c1f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879b59e640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 0x7f879c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 -- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b4a20 msgr2=0x7f879c1f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b4a20 0x7f879c1f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 -- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 msgr2=0x7f879c14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 0x7f879c14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 -- 172.21.15.119:0/3273001636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c14e3e0 con 0x7f879c072050 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879b59e640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 0x7f879c14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f879ad9d640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d5f0 tx=0x7f878c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c0125f0 con 0x7f879c072050 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c019070 con 0x7f879c072050 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c14e6c0 con 0x7f879c072050 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c0129d0 con 0x7f879c072050 2024-09-12T02:34:45.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.910+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c14ec80 con 0x7f879c072050 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.911+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c0ad020 con 0x7f879c072050 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.912+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f878c012b70 con 0x7f879c072050 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.912+0000 7f87937fe640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 0x7f877c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.912+0000 7f879a59c640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 0x7f877c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.912+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5824+0+0 (secure 0 0 0) 0x7f878c08b210 con 0x7f879c072050 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.913+0000 7f879a59c640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 0x7f877c06e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d0ba0 tx=0x7f8784031000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:45.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:45.916+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f878c059be0 con 0x7f879c072050 2024-09-12T02:34:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.081+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f879c073480 con 0x7f879c072050 2024-09-12T02:34:46.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.783+0000 7f87937fe640 1 -- 172.21.15.119:0/3273001636 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f878c0594e0 con 0x7f879c072050 2024-09-12T02:34:46.784 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' removed 2024-09-12T02:34:46.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.786+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 msgr2=0x7f877c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.786+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 0x7f877c06e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d0ba0 tx=0x7f8784031000 comp rx=0 tx=0).stop 2024-09-12T02:34:46.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.786+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 msgr2=0x7f879c15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.786+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d5f0 tx=0x7f878c00dab0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 shutdown_connections 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f877c06be60 0x7f877c06e320 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d0ba0 tx=0x7f8784031000 comp rx=0 tx=0).stop 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15e900 0x7f879c14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b4a20 0x7f879c1f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 --2- 172.21.15.119:0/3273001636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c072050 0x7f879c15a890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 >> 172.21.15.119:0/3273001636 conn(0x7f879c06bdf0 msgr2=0x7f879c15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.787+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 shutdown_connections 2024-09-12T02:34:46.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.788+0000 7f87a110a640 1 -- 172.21.15.119:0/3273001636 wait complete. 2024-09-12T02:34:46.804 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:34:46.805 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:34:46.805 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:34:46.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:46.805 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:34:46.805 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:34:46.806 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:34:46.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:46.806 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:34:46.806 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:34:46.806 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:34:46.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:46.806 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:34:46.807 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:34:46.807 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:34:46.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:46.814 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:34:46.815 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:34:46.815 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:34:46.816 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:34:46.819 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:34:46.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:34:46.819 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:34:46.820 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:34:46.857 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:34:46.857 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:46.858 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:34:46.858 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:46.862 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:34:46.862 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:46.862 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:34:46.863 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:46.863 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:34:46.932 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-09-12T02:34:46.933 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2024-09-12T02:34:46.947 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-12T02:34:46.947 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-12T02:34:46.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.966+0000 7f2b31931640 1 Processor -- start 2024-09-12T02:34:46.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.966+0000 7f2b31931640 1 -- start start 2024-09-12T02:34:46.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b31931640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2b2c09aa30 0x7f2b2c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:46.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b31931640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c0b2790 con 0x7f2b2c06cd20 2024-09-12T02:34:46.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b31931640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c0b2a70 con 0x7f2b2c0b3760 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b31931640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c0d0670 con 0x7f2b2c09aa30 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b2affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2b2c09aa30 0x7f2b2c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b2b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2b2c06cd20 0x7f2b2c162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60596/0 (socket says 172.21.15.119:60596) 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.967+0000 7f2b2b7fe640 1 -- 172.21.15.119:0/407538046 learned_addr learned my addr 172.21.15.119:0/407538046 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b2affd640 1 -- 172.21.15.119:0/407538046 >> v1:172.21.15.153:6789/0 conn(0x7f2b2c0b3760 legacy=0x7f2b2c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b2affd640 1 -- 172.21.15.119:0/407538046 >> v1:172.21.15.119:6789/0 conn(0x7f2b2c06cd20 legacy=0x7f2b2c162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b2affd640 1 -- 172.21.15.119:0/407538046 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0b2d50 con 0x7f2b2c09aa30 2024-09-12T02:34:46.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b29ffb640 1 -- 172.21.15.119:0/407538046 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583606392 0 0) 0x7f2b2c0b2790 con 0x7f2b2c06cd20 2024-09-12T02:34:46.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b2affd640 1 --2- 172.21.15.119:0/407538046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0b3030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0097a0 tx=0x7f2b1c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e295680bf392002 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.968+0000 7f2b29ffb640 1 -- 172.21.15.119:0/407538046 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c037070 con 0x7f2b2c09aa30 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b29ffb640 1 -- 172.21.15.119:0/407538046 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c02adc0 con 0x7f2b2c09aa30 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b29ffb640 1 -- 172.21.15.119:0/407538046 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c032660 con 0x7f2b2c09aa30 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 -- 172.21.15.119:0/407538046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c09aa30 msgr2=0x7f2b2c0b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 --2- 172.21.15.119:0/407538046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0b3030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0097a0 tx=0x7f2b1c02a0b0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 -- 172.21.15.119:0/407538046 shutdown_connections 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 --2- 172.21.15.119:0/407538046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0b3030 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 -- 172.21.15.119:0/407538046 >> 172.21.15.119:0/407538046 conn(0x7f2b2c0d23a0 msgr2=0x7f2b2c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 -- 172.21.15.119:0/407538046 shutdown_connections 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.969+0000 7f2b31931640 1 -- 172.21.15.119:0/407538046 wait complete. 2024-09-12T02:34:46.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.970+0000 7f2b31931640 1 Processor -- start 2024-09-12T02:34:46.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.970+0000 7f2b31931640 1 -- start start 2024-09-12T02:34:46.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b2c06cd20 0x7f2b2c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:46.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c15fe20 con 0x7f2b2c0b3760 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c15fca0 con 0x7f2b2c09aa30 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b31931640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0d1fe0 con 0x7f2b2c06cd20 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b2b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b2b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59884/0 (socket says 172.21.15.119:59884) 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.971+0000 7f2b2b7fe640 1 -- 172.21.15.119:0/1667601939 learned_addr learned my addr 172.21.15.119:0/1667601939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 -- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b2c06cd20 msgr2=0x7f2b2c15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b2c06cd20 0x7f2b2c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 -- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2c09aa30 msgr2=0x7f2b2c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 -- 172.21.15.119:0/1667601939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c09fd30 con 0x7f2b2c0b3760 2024-09-12T02:34:46.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b2b7fe640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c700 tx=0x7f2b2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24018070 con 0x7f2b2c0b3760 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2400ce10 con 0x7f2b2c0b3760 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c0a0010 con 0x7f2b2c0b3760 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400a860 con 0x7f2b2c0b3760 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.972+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1f5a10 con 0x7f2b2c0b3760 2024-09-12T02:34:46.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.973+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c0b3030 con 0x7f2b2c0b3760 2024-09-12T02:34:46.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.974+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b2401b070 con 0x7f2b2c0b3760 2024-09-12T02:34:46.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.974+0000 7f2b13fff640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 0x7f2b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:46.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.974+0000 7f2b2affd640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 0x7f2b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:46.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.974+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f2b2408a280 con 0x7f2b2c0b3760 2024-09-12T02:34:46.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.975+0000 7f2b2affd640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 0x7f2b1806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c02c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:46.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:46.979+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b24058e30 con 0x7f2b2c0b3760 2024-09-12T02:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.156+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2b2c0af9a0 con 0x7f2b2c0b3760 2024-09-12T02:34:47.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.797+0000 7f2b13fff640 1 -- 172.21.15.119:0/1667601939 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f2b24058730 con 0x7f2b2c0b3760 2024-09-12T02:34:47.799 INFO:teuthology.orchestra.run.smithi119.stderr: removed all blocklist entries 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.799+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 msgr2=0x7f2b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 0x7f2b1806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c02c000 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 msgr2=0x7f2b2c0c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c700 tx=0x7f2b2400cbc0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 shutdown_connections 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2b1806be30 0x7f2b1806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c0b3760 0x7f2b2c0c88a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2c09aa30 0x7f2b2c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 --2- 172.21.15.119:0/1667601939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b2c06cd20 0x7f2b2c15a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 >> 172.21.15.119:0/1667601939 conn(0x7f2b2c0d23a0 msgr2=0x7f2b2c0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:47.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 shutdown_connections 2024-09-12T02:34:47.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.800+0000 7f2b31931640 1 -- 172.21.15.119:0/1667601939 wait complete. 2024-09-12T02:34:47.813 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:34:47.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.910+0000 7fa3318dd640 1 Processor -- start 2024-09-12T02:34:47.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.910+0000 7fa3318dd640 1 -- start start 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.911+0000 7fa3318dd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa32c09aa30 0x7fa32c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.911+0000 7fa3318dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 0x7fa32c09ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.911+0000 7fa3318dd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32c09b350 con 0x7fa32c06cd20 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.911+0000 7fa3318dd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c0d0670 con 0x7fa32c09aa30 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.911+0000 7fa3318dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0b2790 con 0x7fa32c0b3760 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32affd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa32c09aa30 0x7fa32c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32a7fc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 0x7fa32c09ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32b7fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa32c06cd20 0x7fa32c0d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:50766/0 (socket says 172.21.15.119:50766) 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32b7fe640 1 -- 172.21.15.119:0/1897663505 learned_addr learned my addr 172.21.15.119:0/1897663505 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa329ffb640 1 -- 172.21.15.119:0/1897663505 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20138643 0 0) 0x7fa32c09b350 con 0x7fa32c06cd20 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa329ffb640 1 -- 172.21.15.119:0/1897663505 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa314003520 con 0x7fa32c06cd20 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32a7fc640 1 -- 172.21.15.119:0/1897663505 >> v2:172.21.15.153:3300/0 conn(0x7fa32c09aa30 msgr2=0x7fa32c0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:47.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32a7fc640 1 --2- 172.21.15.119:0/1897663505 >> v2:172.21.15.153:3300/0 conn(0x7fa32c09aa30 0x7fa32c0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32a7fc640 1 -- 172.21.15.119:0/1897663505 >> v1:172.21.15.153:6789/0 conn(0x7fa32c06cd20 legacy=0x7fa32c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.912+0000 7fa32a7fc640 1 -- 172.21.15.119:0/1897663505 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0b2a70 con 0x7fa32c0b3760 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa32a7fc640 1 --2- 172.21.15.119:0/1897663505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 0x7fa32c09ae10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3200097a0 tx=0x7fa32002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63881e016cb4dda0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa329ffb640 1 -- 172.21.15.119:0/1897663505 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320037070 con 0x7fa32c0b3760 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa329ffb640 1 -- 172.21.15.119:0/1897663505 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32002ae50 con 0x7fa32c0b3760 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa329ffb640 1 -- 172.21.15.119:0/1897663505 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320032640 con 0x7fa32c0b3760 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 -- 172.21.15.119:0/1897663505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 msgr2=0x7fa32c09ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 --2- 172.21.15.119:0/1897663505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 0x7fa32c09ae10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3200097a0 tx=0x7fa32002a100 comp rx=0 tx=0).stop 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 -- 172.21.15.119:0/1897663505 shutdown_connections 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 --2- 172.21.15.119:0/1897663505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c0b3760 0x7fa32c09ae10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 --2- 172.21.15.119:0/1897663505 >> v2:172.21.15.153:3300/0 conn(0x7fa32c09aa30 0x7fa32c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.913+0000 7fa3318dd640 1 -- 172.21.15.119:0/1897663505 >> 172.21.15.119:0/1897663505 conn(0x7fa32c0d23a0 msgr2=0x7fa32c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.914+0000 7fa3318dd640 1 -- 172.21.15.119:0/1897663505 shutdown_connections 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.914+0000 7fa3318dd640 1 -- 172.21.15.119:0/1897663505 wait complete. 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.915+0000 7fa3318dd640 1 Processor -- start 2024-09-12T02:34:47.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.915+0000 7fa3318dd640 1 -- start start 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.915+0000 7fa3318dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c06cd20 0x7fa32c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa32c0b3760 0x7fa32c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c15fca0 con 0x7fa32c09aa30 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c0d08a0 con 0x7fa32c0b3760 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c15fe20 con 0x7fa32c06cd20 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59896/0 (socket says 172.21.15.119:59896) 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 -- 172.21.15.119:0/3344121305 learned_addr learned my addr 172.21.15.119:0/3344121305 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32affd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c06cd20 0x7fa32c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32b7fe640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa32c0b3760 0x7fa32c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 -- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c06cd20 msgr2=0x7fa32c0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c06cd20 0x7fa32c0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 -- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa32c0b3760 msgr2=0x7fa32c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa32c0b3760 0x7fa32c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 -- 172.21.15.119:0/3344121305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0b68e0 con 0x7fa32c09aa30 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa32a7fc640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa320000c00 tx=0x7fa3200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320041070 con 0x7fa32c09aa30 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32003c460 con 0x7fa32c09aa30 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c0b6bc0 con 0x7fa32c09aa30 2024-09-12T02:34:47.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320037040 con 0x7fa32c09aa30 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.916+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c0b7180 con 0x7fa32c09aa30 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.917+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c0d1fe0 con 0x7fa32c09aa30 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.918+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa320044070 con 0x7fa32c09aa30 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.918+0000 7fa313fff640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 0x7fa31806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.918+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fa3200ab190 con 0x7fa32c09aa30 2024-09-12T02:34:47.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.918+0000 7fa32affd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 0x7fa31806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:47.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.919+0000 7fa32affd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 0x7fa31806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa31c011340 tx=0x7fa31c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:47.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:47.922+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa320079740 con 0x7fa32c09aa30 2024-09-12T02:34:48.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.149+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa32c0b3cb0 con 0x7fa32c09aa30 2024-09-12T02:34:48.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.150+0000 7fa313fff640 1 -- 172.21.15.119:0/3344121305 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fa32007da40 con 0x7fa32c09aa30 2024-09-12T02:34:48.150 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:48.150 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "auth_dump": [ 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.a", 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDdUuJmQJauMBAA446bz+yLXbIF56Q7q1xZQg==", 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.151 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.b", 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmGtIGARAAGIt1SaHZ/uM3FM9lOnkQqA==", 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.152 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.c", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDdUuJmBkS3NxAAoV5JAB0+UwjZMLAK/ZEQQw==", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.d", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmuccSCBAAEwNAFHc4PNw06i4S4+UX6Q==", 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.153 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.0", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDhUuJmK2qnJRAAaKr+x3dts+TvYU389mmH8Q==", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.1", 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDlUuJm8vfQCBAAholmz2UE/LZOIy2ISuEMKQ==", 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.2", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDoUuJm03iAGRAAAnJIcIc4/xNodtHMZIdcGw==", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.3", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDrUuJmavgCGxAALJ99wOytjLAfyehVsUuNGg==", 2024-09-12T02:34:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.4", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDxUuJmFx4aOBAAIoG6g2egFn6Zl1NAE5SH7w==", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.157 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.5", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQD0UuJmaMzPOhAAuPsD8kT49oNGjzJgMDA+cQ==", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.6", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQD4UuJm2WZ2DxAAk2TS0yXxgl32Zo/TzbwHGA==", 2024-09-12T02:34:48.158 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.7", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQD7UuJmZHGkEBAAzgkqZbOlDWy0v+Mt1wkMrg==", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.159 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.0", 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmPVgaDBAAWRowUlPoFE58xP7z/Jaokg==", 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.160 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.1", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmlFfMFBAAu19TdPZwKjilMOb3s064Kw==", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.2", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmZy2hERAABRBpE6P+++St5dByc0hvDA==", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.3", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDeUuJmCjRoGhAABmpFsmpQCuRJpaF9yu+wkg==", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.admin", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDdUuJmpptsFBAAhYwgwFzbYysVR3ovXxDUFw==", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mds", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+Jmt7CqCRAA4HKN5JtnC2gUWai4qVU0zA==", 2024-09-12T02:34:48.163 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+JmWbiqCRAAPDk8ajzR3pJrE+5TQncwOQ==", 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-osd", 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+JmKcCqCRAAbzcdP5aTqoEss3TG2A6lag==", 2024-09-12T02:34:48.164 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+JmJMeqCRAA0InGkWWOmGDkKlzyx8aKLQ==", 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.165 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+Jm3s2qCRAA8422sPRroN7Nt2RZzAshVQ==", 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABU+Jmr9SqCRAA9UMiiQ4xUFTYXjcV4WX66A==", 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.x", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDdUuJmRVh9LRAAHyGFkRBImlL/9YPRrg1sNg==", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.y", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQDdUuJmjCxJKRAA5BjcgNeqmY3WvOYxLv6iWQ==", 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-09-12T02:34:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:34:48.168 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:34:48.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 msgr2=0x7fa31806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 0x7fa31806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa31c011340 tx=0x7fa31c00b040 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 msgr2=0x7fa32c0b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa320000c00 tx=0x7fa3200046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 shutdown_connections 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa31806be30 0x7fa31806e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa32c0b3760 0x7fa32c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa32c09aa30 0x7fa32c0b7980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 --2- 172.21.15.119:0/3344121305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32c06cd20 0x7fa32c0b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 >> 172.21.15.119:0/3344121305 conn(0x7fa32c0d23a0 msgr2=0x7fa32c15d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 shutdown_connections 2024-09-12T02:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.152+0000 7fa3318dd640 1 -- 172.21.15.119:0/3344121305 wait complete. 2024-09-12T02:34:48.171 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T02:34:48.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 Processor -- start 2024-09-12T02:34:48.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 -- start start 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f38ec145bc0 0x7f38ec15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 0x7f38ec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 0x7f38ec06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f38ec0b3570 con 0x7f38ec145bc0 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f38ec0b3850 con 0x7f38ec09aa30 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.269+0000 7f38f3017640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0b3b30 con 0x7f38ec0ae140 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f38ec145bc0 0x7f38ec15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f38ec145bc0 0x7f38ec15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46700/0 (socket says 172.21.15.119:46700) 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 -- 172.21.15.119:0/1252535537 learned_addr learned my addr 172.21.15.119:0/1252535537 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38ebfff640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 0x7f38ec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f15b4640 1 --2- 172.21.15.119:0/1252535537 >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 0x7f38ec06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 -- 172.21.15.119:0/1252535537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 msgr2=0x7f38ec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 0x7f38ec06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 -- 172.21.15.119:0/1252535537 >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 msgr2=0x7f38ec06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 --2- 172.21.15.119:0/1252535537 >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 0x7f38ec06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f0db3640 1 -- 172.21.15.119:0/1252535537 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec0b1610 con 0x7f38ec145bc0 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38ebfff640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 0x7f38ec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.270+0000 7f38f15b4640 1 --2- 172.21.15.119:0/1252535537 >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 0x7f38ec06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f0db3640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec15ca70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0ae560 tx=0x7f38e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49392aaf6b5f76f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38eb7fe640 1 -- 172.21.15.119:0/1252535537 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4037070 con 0x7f38ec145bc0 2024-09-12T02:34:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38eb7fe640 1 -- 172.21.15.119:0/1252535537 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e4032440 con 0x7f38ec145bc0 2024-09-12T02:34:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38eb7fe640 1 -- 172.21.15.119:0/1252535537 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4032810 con 0x7f38ec145bc0 2024-09-12T02:34:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 -- 172.21.15.119:0/1252535537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 msgr2=0x7f38ec15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec15ca70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0ae560 tx=0x7f38e402a270 comp rx=0 tx=0).stop 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 -- 172.21.15.119:0/1252535537 shutdown_connections 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 --2- 172.21.15.119:0/1252535537 >> v2:172.21.15.153:3300/0 conn(0x7f38ec09aa30 0x7f38ec06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec0ae140 0x7f38ec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 --2- 172.21.15.119:0/1252535537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec15ca70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 -- 172.21.15.119:0/1252535537 >> 172.21.15.119:0/1252535537 conn(0x7f38ec073490 msgr2=0x7f38ec0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.271+0000 7f38f3017640 1 -- 172.21.15.119:0/1252535537 shutdown_connections 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.272+0000 7f38f3017640 1 -- 172.21.15.119:0/1252535537 wait complete. 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.273+0000 7f38f3017640 1 Processor -- start 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.273+0000 7f38f3017640 1 -- start start 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.273+0000 7f38f3017640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec09aa30 0x7f38ec0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.273+0000 7f38f3017640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 0x7f38ec1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.273+0000 7f38f3017640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f3017640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec145fa0 con 0x7f38ec145bc0 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f3017640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0b1e10 con 0x7f38ec0ae140 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f3017640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0c6dc0 con 0x7f38ec09aa30 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46716/0 (socket says 172.21.15.119:46716) 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 -- 172.21.15.119:0/3187731861 learned_addr learned my addr 172.21.15.119:0/3187731861 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38ebfff640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 0x7f38ec1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f0db3640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec09aa30 0x7f38ec0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 -- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec09aa30 msgr2=0x7f38ec0d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec09aa30 0x7f38ec0d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 -- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 msgr2=0x7f38ec1f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 0x7f38ec1f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 -- 172.21.15.119:0/3187731861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec0c70a0 con 0x7f38ec145bc0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38ebfff640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 0x7f38ec1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f15b4640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38d400c7f0 tx=0x7f38d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4015070 con 0x7f38ec145bc0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d4007820 con 0x7f38ec145bc0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec0c7380 con 0x7f38ec145bc0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4007c50 con 0x7f38ec145bc0 2024-09-12T02:34:48.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.274+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec0c60d0 con 0x7f38ec145bc0 2024-09-12T02:34:48.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.275+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec15ca70 con 0x7f38ec145bc0 2024-09-12T02:34:48.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.276+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38d4018070 con 0x7f38ec145bc0 2024-09-12T02:34:48.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.276+0000 7f38e97fa640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 0x7f38cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.276+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f38d408adf0 con 0x7f38ec145bc0 2024-09-12T02:34:48.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.276+0000 7f38f0db3640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 0x7f38cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.277+0000 7f38f0db3640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 0x7f38cc06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38e4034000 tx=0x7f38e402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.280+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38d40599f0 con 0x7f38ec145bc0 2024-09-12T02:34:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.512+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f38ec06fe80 con 0x7f38ec145bc0 2024-09-12T02:34:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.514+0000 7f38e97fa640 1 -- 172.21.15.119:0/3187731861 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f38d40592f0 con 0x7f38ec145bc0 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 msgr2=0x7f38cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 0x7f38cc06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38e4034000 tx=0x7f38e402e000 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 msgr2=0x7f38ec1f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38d400c7f0 tx=0x7f38d400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 shutdown_connections 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f38cc06be30 0x7f38cc06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38ec145bc0 0x7f38ec1f59c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38ec0ae140 0x7f38ec1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 --2- 172.21.15.119:0/3187731861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38ec09aa30 0x7f38ec0d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 >> 172.21.15.119:0/3187731861 conn(0x7f38ec073490 msgr2=0x7f38ec15d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 shutdown_connections 2024-09-12T02:34:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.517+0000 7f38f3017640 1 -- 172.21.15.119:0/3187731861 wait complete. 2024-09-12T02:34:48.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T02:34:48.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.626+0000 7f65ebf5b640 1 Processor -- start 2024-09-12T02:34:48.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.627+0000 7f65ebf5b640 1 -- start start 2024-09-12T02:34:48.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.627+0000 7f65ebf5b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65e415ba30 0x7f65e406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.627+0000 7f65ebf5b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65ebf5b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b3570 con 0x7f65e4072e80 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65ebf5b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f65e40b4180 con 0x7f65e415ba30 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65ebf5b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65e40b3850 con 0x7f65e406fd50 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65e415ba30 0x7f65e406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65ea4f8640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f65e4072e80 0x7f65e406e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48206/0 (socket says 172.21.15.119:48206) 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65e415ba30 0x7f65e406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46732/0 (socket says 172.21.15.119:46732) 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65ea4f8640 1 -- 172.21.15.119:0/955198182 learned_addr learned my addr 172.21.15.119:0/955198182 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 -- 172.21.15.119:0/955198182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 msgr2=0x7f65e4072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 --2- 172.21.15.119:0/955198182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 -- 172.21.15.119:0/955198182 >> v1:172.21.15.119:6789/0 conn(0x7f65e4072e80 legacy=0x7f65e406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e8cf5640 1 -- 172.21.15.119:0/955198182 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679243545 0 0) 0x7f65e40b3570 con 0x7f65e4072e80 2024-09-12T02:34:48.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.628+0000 7f65e9cf7640 1 -- 172.21.15.119:0/955198182 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40b3b30 con 0x7f65e415ba30 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65e9cf7640 1 --2- 172.21.15.119:0/955198182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e415ba30 0x7f65e406f810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828a61528bd0b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65e8cf5640 1 -- 172.21.15.119:0/955198182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65e415ba30 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65e8cf5640 1 -- 172.21.15.119:0/955198182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0032440 con 0x7f65e415ba30 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65e8cf5640 1 -- 172.21.15.119:0/955198182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0032810 con 0x7f65e415ba30 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 -- 172.21.15.119:0/955198182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e415ba30 msgr2=0x7f65e406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/955198182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e415ba30 0x7f65e406f810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 -- 172.21.15.119:0/955198182 shutdown_connections 2024-09-12T02:34:48.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/955198182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/955198182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e415ba30 0x7f65e406f810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 -- 172.21.15.119:0/955198182 >> 172.21.15.119:0/955198182 conn(0x7f65e4067d70 msgr2=0x7f65e406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 -- 172.21.15.119:0/955198182 shutdown_connections 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.629+0000 7f65ebf5b640 1 -- 172.21.15.119:0/955198182 wait complete. 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 Processor -- start 2024-09-12T02:34:48.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 -- start start 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e415ba30 0x7f65e4151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40b5890 con 0x7f65e4072e80 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40ce810 con 0x7f65e415ba30 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65ebf5b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65e40b5a10 con 0x7f65e406fd50 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65e94f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65e94f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46738/0 (socket says 172.21.15.119:46738) 2024-09-12T02:34:48.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.631+0000 7f65e94f6640 1 -- 172.21.15.119:0/3824631302 learned_addr learned my addr 172.21.15.119:0/3824631302 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 -- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 msgr2=0x7f65e4155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 -- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e415ba30 msgr2=0x7f65e4151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e415ba30 0x7f65e4151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 -- 172.21.15.119:0/3824631302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e414f2d0 con 0x7f65e4072e80 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65e94f6640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65d800b430 tx=0x7f65d800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8015020 con 0x7f65e4072e80 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8011830 con 0x7f65e4072e80 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011c20 con 0x7f65e4072e80 2024-09-12T02:34:48.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e414f5b0 con 0x7f65e4072e80 2024-09-12T02:34:48.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.632+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e40adcb0 con 0x7f65e4072e80 2024-09-12T02:34:48.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.633+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e40adeb0 con 0x7f65e4072e80 2024-09-12T02:34:48.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.633+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65d8018020 con 0x7f65e4072e80 2024-09-12T02:34:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.634+0000 7f65d67fc640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.634+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f65d808ab10 con 0x7f65e4072e80 2024-09-12T02:34:48.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.634+0000 7f65e9cf7640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.634+0000 7f65e9cf7640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 0x7f65c806e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.638+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65e40adeb0 con 0x7f65e4072e80 2024-09-12T02:34:48.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.871+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f65e40ccfe0 con 0x7f65e4072e80 2024-09-12T02:34:48.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.873+0000 7f65d67fc640 1 -- 172.21.15.119:0/3824631302 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f65d801f020 con 0x7f65e4072e80 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 msgr2=0x7f65c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 0x7f65c806e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002c000 comp rx=0 tx=0).stop 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 msgr2=0x7f65e415d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65d800b430 tx=0x7f65d800b8f0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 shutdown_connections 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e415ba30 0x7f65e4151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4072e80 0x7f65e415d850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 --2- 172.21.15.119:0/3824631302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65e406fd50 0x7f65e4155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 >> 172.21.15.119:0/3824631302 conn(0x7f65e4067d70 msgr2=0x7f65e40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 shutdown_connections 2024-09-12T02:34:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.875+0000 7f65ebf5b640 1 -- 172.21.15.119:0/3824631302 wait complete. 2024-09-12T02:34:48.887 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T02:34:48.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 Processor -- start 2024-09-12T02:34:48.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 -- start start 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 0x7facf009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7facf00b1620 0x7facf00b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf00cec00 con 0x7facf015c520 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7facf009bd90 con 0x7facf00b1620 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.985+0000 7facf53a8640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7facf00d0010 con 0x7facf00d1090 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7facf00b1620 0x7facf00b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7facf00b1620 0x7facf00b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46748/0 (socket says 172.21.15.119:46748) 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 -- 172.21.15.119:0/4034522772 learned_addr learned my addr 172.21.15.119:0/4034522772 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7face7fff640 1 --2- 172.21.15.119:0/4034522772 >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 0x7facf009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 -- 172.21.15.119:0/4034522772 >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 msgr2=0x7facf009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 --2- 172.21.15.119:0/4034522772 >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 0x7facf009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 -- 172.21.15.119:0/4034522772 >> v1:172.21.15.153:6789/0 conn(0x7facf015c520 legacy=0x7facf00d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 -- 172.21.15.119:0/4034522772 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf00d02f0 con 0x7facf00b1620 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7face7fff640 1 --2- 172.21.15.119:0/4034522772 >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 0x7facf009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.986+0000 7facef7fe640 1 --2- 172.21.15.119:0/4034522772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf00b1d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facf00730f0 tx=0x7face802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20170db512ae3989 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facee7fc640 1 -- 172.21.15.119:0/4034522772 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8036070 con 0x7facf00b1620 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facee7fc640 1 -- 172.21.15.119:0/4034522772 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face8031600 con 0x7facf00b1620 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facee7fc640 1 -- 172.21.15.119:0/4034522772 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80319d0 con 0x7facf00b1620 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 -- 172.21.15.119:0/4034522772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 msgr2=0x7facf00b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 --2- 172.21.15.119:0/4034522772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf00b1d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facf00730f0 tx=0x7face802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 -- 172.21.15.119:0/4034522772 shutdown_connections 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 --2- 172.21.15.119:0/4034522772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf00b1d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 --2- 172.21.15.119:0/4034522772 >> v2:172.21.15.153:3300/0 conn(0x7facf00d1090 0x7facf009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 -- 172.21.15.119:0/4034522772 >> 172.21.15.119:0/4034522772 conn(0x7facf00d23a0 msgr2=0x7facf00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 -- 172.21.15.119:0/4034522772 shutdown_connections 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.987+0000 7facf53a8640 1 -- 172.21.15.119:0/4034522772 wait complete. 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.988+0000 7facf53a8640 1 Processor -- start 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.988+0000 7facf53a8640 1 -- start start 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 0x7facf01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf015c520 0x7facf006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7facf015c900 con 0x7facf00b1620 2024-09-12T02:34:48.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7facf00d05d0 con 0x7facf015c520 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7facf53a8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7facf006dbf0 con 0x7facf00d1090 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7faceeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7faceeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46754/0 (socket says 172.21.15.119:46754) 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.989+0000 7faceeffd640 1 -- 172.21.15.119:0/4285123242 learned_addr learned my addr 172.21.15.119:0/4285123242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7face7fff640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 0x7facf01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7facef7fe640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf015c520 0x7facf006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 -- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 msgr2=0x7facf01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 0x7facf01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 -- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf015c520 msgr2=0x7facf006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf015c520 0x7facf006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 -- 172.21.15.119:0/4285123242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf01f5830 con 0x7facf00b1620 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7face7fff640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 0x7facf01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:48.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7faceeffd640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7face000b3f0 tx=0x7face000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0015020 con 0x7facf00b1620 2024-09-12T02:34:48.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face0011830 con 0x7facf00b1620 2024-09-12T02:34:48.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0011c20 con 0x7facf00b1620 2024-09-12T02:34:48.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf006eaa0 con 0x7facf00b1620 2024-09-12T02:34:48.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.990+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf006d630 con 0x7facf00b1620 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.991+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf00b8320 con 0x7facf00b1620 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.991+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7face0018020 con 0x7facf00b1620 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.992+0000 7face77fe640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 0x7facd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.992+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7face008a850 con 0x7facf00b1620 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.992+0000 7face7fff640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 0x7facd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.992+0000 7face7fff640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 0x7facd006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facf00b11b0 tx=0x7facd8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:48.996+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7face001f030 con 0x7facf00b1620 2024-09-12T02:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.227+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7facf00ce7b0 con 0x7facf00b1620 2024-09-12T02:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.229+0000 7face77fe640 1 -- 172.21.15.119:0/4285123242 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7face00172c0 con 0x7facf00b1620 2024-09-12T02:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 msgr2=0x7facd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 0x7facd006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facf00b11b0 tx=0x7facd8008040 comp rx=0 tx=0).stop 2024-09-12T02:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 msgr2=0x7facf01f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7face000b3f0 tx=0x7face000b8b0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 shutdown_connections 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7facd006be30 0x7facd006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf015c520 0x7facf006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facf00d1090 0x7facf01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 --2- 172.21.15.119:0/4285123242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00b1620 0x7facf01f52f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 >> 172.21.15.119:0/4285123242 conn(0x7facf00d23a0 msgr2=0x7facf00d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 shutdown_connections 2024-09-12T02:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.231+0000 7facf53a8640 1 -- 172.21.15.119:0/4285123242 wait complete. 2024-09-12T02:34:49.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T02:34:49.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.342+0000 7f607385e640 1 Processor -- start 2024-09-12T02:34:49.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.342+0000 7f607385e640 1 -- start start 2024-09-12T02:34:49.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f607385e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f606c0b69d0 0x7f606c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f607385e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606c15eb60 con 0x7f606c0af280 2024-09-12T02:34:49.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f607385e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606c15ee40 con 0x7f606c0b0180 2024-09-12T02:34:49.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f607385e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f606c0b6db0 con 0x7f606c0b69d0 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6070df9640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f606c0af280 0x7f606c0afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48220/0 (socket says 172.21.15.119:48220) 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6070df9640 1 -- 172.21.15.119:0/2338304109 learned_addr learned my addr 172.21.15.119:0/2338304109 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f60715fa640 1 --2- 172.21.15.119:0/2338304109 >> v2:172.21.15.153:3300/0 conn(0x7f606c0b69d0 0x7f606c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373626550 0 0) 0x7f606c15eb60 con 0x7f606c0af280 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6058003520 con 0x7f606c0af280 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 204772640 0 0) 0x7f6058003520 con 0x7f606c0af280 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 >> v2:172.21.15.153:3300/0 conn(0x7f606c0b69d0 msgr2=0x7f606c162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 --2- 172.21.15.119:0/2338304109 >> v2:172.21.15.153:3300/0 conn(0x7f606c0b69d0 0x7f606c162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 >> v1:172.21.15.153:6789/0 conn(0x7f606c0b0180 legacy=0x7f606c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c15f120 con 0x7f606c0af280 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f605c001670 con 0x7f606c0af280 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 >> v1:172.21.15.119:6789/0 conn(0x7f606c0af280 legacy=0x7f606c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f6058003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6058004800 0x7f6058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60580052e0 0x7f605800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.343+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f606c0b6db0 con 0x7f60580039b0 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f605800c1b0 con 0x7f60580052e0 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f605800c3b0 con 0x7f6058004800 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f6058003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6070df9640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6058004800 0x7f6058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6071dfb640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60580052e0 0x7f605800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 -- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6058004800 msgr2=0x7f6058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6058004800 0x7f6058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 -- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60580052e0 msgr2=0x7f605800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60580052e0 0x7f605800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f60715fa640 1 -- 172.21.15.119:0/2338304109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6058003520 con 0x7f60580039b0 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6071dfb640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60580052e0 0x7f605800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.344+0000 7f6071dfb640 1 -- 172.21.15.119:0/2338304109 reap_dead start 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f60715fa640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f6058003df0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6068009ac0 tx=0x7f6058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62ab33a2211d886 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068036070 con 0x7f60580039b0 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068031400 con 0x7f60580039b0 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f6063fff640 1 -- 172.21.15.119:0/2338304109 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068009690 con 0x7f60580039b0 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 -- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 msgr2=0x7f6058003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f6058003df0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6068009ac0 tx=0x7f6058005830 comp rx=0 tx=0).stop 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 -- 172.21.15.119:0/2338304109 shutdown_connections 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 --2- 172.21.15.119:0/2338304109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f6058003df0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 -- 172.21.15.119:0/2338304109 >> 172.21.15.119:0/2338304109 conn(0x7f606c06bc10 msgr2=0x7f606c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 -- 172.21.15.119:0/2338304109 shutdown_connections 2024-09-12T02:34:49.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.345+0000 7f607385e640 1 -- 172.21.15.119:0/2338304109 wait complete. 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 Processor -- start 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 -- start start 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 0x7f606c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c15d510 0x7f606c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f606c162a50 con 0x7f60580039b0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f606c0af710 con 0x7f606c15d510 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f607385e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f606c162bd0 con 0x7f606c0d01a0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f60715fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f60715fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46778/0 (socket says 172.21.15.119:46778) 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.347+0000 7f60715fa640 1 -- 172.21.15.119:0/867796278 learned_addr learned my addr 172.21.15.119:0/867796278 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6071dfb640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c15d510 0x7f606c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6070df9640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 0x7f606c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 -- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 msgr2=0x7f606c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 0x7f606c157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 -- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c15d510 msgr2=0x7f606c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c15d510 0x7f606c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 -- 172.21.15.119:0/867796278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c157c50 con 0x7f60580039b0 2024-09-12T02:34:49.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6070df9640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 0x7f606c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f60715fa640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f606802abb0 tx=0x7f6068004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606803f020 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068037040 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606c15dfd0 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068036070 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.348+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606c0cd780 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.349+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f606c162200 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.350+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6068042020 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.350+0000 7f6061ffb640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 0x7f605006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.350+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f60680aa9d0 con 0x7f60580039b0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.350+0000 7f6070df9640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 0x7f605006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.351+0000 7f6070df9640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 0x7f605006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f606c0cf4f0 tx=0x7f605c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.355+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6068049070 con 0x7f60580039b0 2024-09-12T02:34:49.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.583+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f606c06fc80 con 0x7f60580039b0 2024-09-12T02:34:49.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.585+0000 7f6061ffb640 1 -- 172.21.15.119:0/867796278 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f606c157c50 con 0x7f60580039b0 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 msgr2=0x7f605006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 0x7f605006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f606c0cf4f0 tx=0x7f605c009040 comp rx=0 tx=0).stop 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 msgr2=0x7f606c1f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f606802abb0 tx=0x7f6068004730 comp rx=0 tx=0).stop 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 shutdown_connections 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f605006be30 0x7f605006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c15d510 0x7f606c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f606c0d01a0 0x7f606c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 --2- 172.21.15.119:0/867796278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580039b0 0x7f606c1f4470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 >> 172.21.15.119:0/867796278 conn(0x7f606c06bc10 msgr2=0x7f606c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 shutdown_connections 2024-09-12T02:34:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.587+0000 7f607385e640 1 -- 172.21.15.119:0/867796278 wait complete. 2024-09-12T02:34:49.600 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T02:34:49.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.697+0000 7fd581e0e640 1 Processor -- start 2024-09-12T02:34:49.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.697+0000 7fd581e0e640 1 -- start start 2024-09-12T02:34:49.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd581e0e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c15e5f0 0x7fd57c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd581e0e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd57c0d30f0 0x7fd57c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd581e0e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0d3690 con 0x7fd57c0b64c0 2024-09-12T02:34:49.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd581e0e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c06d530 con 0x7fd57c0d30f0 2024-09-12T02:34:49.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd581e0e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c0d3970 con 0x7fd57c15e5f0 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd57affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd57c0d30f0 0x7fd57c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd57affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd57c0d30f0 0x7fd57c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46784/0 (socket says 172.21.15.119:46784) 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.698+0000 7fd57affd640 1 -- 172.21.15.119:0/3825404821 learned_addr learned my addr 172.21.15.119:0/3825404821 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57affd640 1 -- 172.21.15.119:0/3825404821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c15e5f0 msgr2=0x7fd57c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57affd640 1 --2- 172.21.15.119:0/3825404821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c15e5f0 0x7fd57c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57affd640 1 -- 172.21.15.119:0/3825404821 >> v1:172.21.15.153:6789/0 conn(0x7fd57c0b64c0 legacy=0x7fd57c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:49.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57affd640 1 -- 172.21.15.119:0/3825404821 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c06cee0 con 0x7fd57c0d30f0 2024-09-12T02:34:49.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57affd640 1 --2- 172.21.15.119:0/3825404821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c0b5f80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd57002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e551e84eb3910f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57a7fc640 1 -- 172.21.15.119:0/3825404821 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570037070 con 0x7fd57c0d30f0 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57a7fc640 1 -- 172.21.15.119:0/3825404821 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd570032440 con 0x7fd57c0d30f0 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.699+0000 7fd57a7fc640 1 -- 172.21.15.119:0/3825404821 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570032810 con 0x7fd57c0d30f0 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 -- 172.21.15.119:0/3825404821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 msgr2=0x7fd57c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 --2- 172.21.15.119:0/3825404821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c0b5f80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd57002a210 comp rx=0 tx=0).stop 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 -- 172.21.15.119:0/3825404821 shutdown_connections 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 --2- 172.21.15.119:0/3825404821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c0b5f80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 --2- 172.21.15.119:0/3825404821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c15e5f0 0x7fd57c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 -- 172.21.15.119:0/3825404821 >> 172.21.15.119:0/3825404821 conn(0x7fd57c08bfc0 msgr2=0x7fd57c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 -- 172.21.15.119:0/3825404821 shutdown_connections 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.700+0000 7fd581e0e640 1 -- 172.21.15.119:0/3825404821 wait complete. 2024-09-12T02:34:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.701+0000 7fd581e0e640 1 Processor -- start 2024-09-12T02:34:49.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.701+0000 7fd581e0e640 1 -- start start 2024-09-12T02:34:49.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c0b64c0 0x7fd57c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd57c15e5f0 0x7fd57c1f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0d5310 con 0x7fd57c0d30f0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c15e9d0 con 0x7fd57c15e5f0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd581e0e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c06e9d0 con 0x7fd57c0b64c0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46788/0 (socket says 172.21.15.119:46788) 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 -- 172.21.15.119:0/4265933042 learned_addr learned my addr 172.21.15.119:0/4265933042 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 -- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c0b64c0 msgr2=0x7fd57c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c0b64c0 0x7fd57c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 -- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd57c15e5f0 msgr2=0x7fd57c1f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd57c15e5f0 0x7fd57c1f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.702+0000 7fd57affd640 1 -- 172.21.15.119:0/4265933042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c0b98f0 con 0x7fd57c0d30f0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd57affd640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd5700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570041070 con 0x7fd57c0d30f0 2024-09-12T02:34:49.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57003c870 con 0x7fd57c0d30f0 2024-09-12T02:34:49.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570037040 con 0x7fd57c0d30f0 2024-09-12T02:34:49.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c1f8480 con 0x7fd57c0d30f0 2024-09-12T02:34:49.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.703+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c0b79b0 con 0x7fd57c0d30f0 2024-09-12T02:34:49.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.704+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c0b5f80 con 0x7fd57c0d30f0 2024-09-12T02:34:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.704+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd570044070 con 0x7fd57c0d30f0 2024-09-12T02:34:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.705+0000 7fd563fff640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 0x7fd56806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.705+0000 7fd57b7fe640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 0x7fd56806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.705+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fd5700ab7b0 con 0x7fd57c0d30f0 2024-09-12T02:34:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.705+0000 7fd57b7fe640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 0x7fd56806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009670 tx=0x7fd56c006bf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:49.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.709+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd57007a440 con 0x7fd57c0d30f0 2024-09-12T02:34:49.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.940+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd57c160340 con 0x7fd57c0d30f0 2024-09-12T02:34:49.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.942+0000 7fd563fff640 1 -- 172.21.15.119:0/4265933042 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fd570079d40 con 0x7fd57c0d30f0 2024-09-12T02:34:49.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 msgr2=0x7fd56806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 0x7fd56806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009670 tx=0x7fd56c006bf0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 msgr2=0x7fd57c1607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:49.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd5700046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 shutdown_connections 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd56806be30 0x7fd56806e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd57c15e5f0 0x7fd57c1f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c0d30f0 0x7fd57c1607d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 --2- 172.21.15.119:0/4265933042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd57c0b64c0 0x7fd57c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 >> 172.21.15.119:0/4265933042 conn(0x7fd57c08bfc0 msgr2=0x7fd57c0b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 shutdown_connections 2024-09-12T02:34:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:49.944+0000 7fd581e0e640 1 -- 172.21.15.119:0/4265933042 wait complete. 2024-09-12T02:34:49.956 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T02:34:50.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.054+0000 7f9b17981640 1 Processor -- start 2024-09-12T02:34:50.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.054+0000 7f9b17981640 1 -- start start 2024-09-12T02:34:50.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b17981640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9b10072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b17981640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b100b4880 0x7f9b100b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b17981640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b100b3570 con 0x7f9b1015ba30 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b17981640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9b100732e0 con 0x7f9b100b4880 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b17981640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b100b4180 con 0x7f9b10072940 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b1571d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9b1015ba30 0x7f9b1006f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48226/0 (socket says 172.21.15.119:48226) 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b1571d640 1 -- 172.21.15.119:0/1863460362 learned_addr learned my addr 172.21.15.119:0/1863460362 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9b10072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b15f1e640 1 --2- 172.21.15.119:0/1863460362 >> v2:172.21.15.153:3300/0 conn(0x7f9b100b4880 0x7f9b100b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214593226 0 0) 0x7f9b100b3570 con 0x7f9b1015ba30 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.055+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af8003520 con 0x7f9b1015ba30 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 87714020 0 0) 0x7f9af8003520 con 0x7f9b1015ba30 2024-09-12T02:34:50.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 msgr2=0x7f9b10072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9b10072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 >> v2:172.21.15.153:3300/0 conn(0x7f9b100b4880 msgr2=0x7f9b100b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 --2- 172.21.15.119:0/1863460362 >> v2:172.21.15.153:3300/0 conn(0x7f9b100b4880 0x7f9b100b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b100b3850 con 0x7f9b1015ba30 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f9b000019f0 con 0x7f9b1015ba30 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 >> v1:172.21.15.119:6789/0 conn(0x7f9b1015ba30 legacy=0x7f9b1006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9af80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9af8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8004d40 0x7f9af80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b100b4180 con 0x7f9af8003f30 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9af800b9c0 con 0x7f9af8004d40 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9af800bb40 con 0x7f9b10072940 2024-09-12T02:34:50.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9af8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b1571d640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9af80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b15f1e640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8004d40 0x7f9af80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 -- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 msgr2=0x7f9af80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10072940 0x7f9af80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 -- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8004d40 msgr2=0x7f9af80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8004d40 0x7f9af80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b14f1c640 1 -- 172.21.15.119:0/1863460362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af8003520 con 0x7f9af8003f30 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.056+0000 7f9b15f1e640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8004d40 0x7f9af80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:50.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9af8004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009a90 tx=0x7f9af8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b18a92b53b4834c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04036070 con 0x7f9af8003f30 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04031400 con 0x7f9af8003f30 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b0ffff640 1 -- 172.21.15.119:0/1863460362 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04009690 con 0x7f9af8003f30 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b17981640 1 -- 172.21.15.119:0/1863460362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 msgr2=0x7f9af8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b17981640 1 --2- 172.21.15.119:0/1863460362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9af8004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009a90 tx=0x7f9af8005830 comp rx=0 tx=0).stop 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b15f1e640 1 -- 172.21.15.119:0/1863460362 reap_dead start 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b17981640 1 -- 172.21.15.119:0/1863460362 shutdown_connections 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b17981640 1 -- 172.21.15.119:0/1863460362 >> 172.21.15.119:0/1863460362 conn(0x7f9b10067d70 msgr2=0x7f9b1006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.057+0000 7f9b17981640 1 -- 172.21.15.119:0/1863460362 shutdown_connections 2024-09-12T02:34:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.058+0000 7f9b17981640 1 -- 172.21.15.119:0/1863460362 wait complete. 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 Processor -- start 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 -- start start 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 0x7f9b1015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 0x7f9b101467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1006ff20 con 0x7f9af8003f30 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b100b3e10 con 0x7f9b10147590 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b17981640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b100ce810 con 0x7f9b10146360 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.059+0000 7f9b1571d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46810/0 (socket says 172.21.15.119:46810) 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 -- 172.21.15.119:0/1392017687 learned_addr learned my addr 172.21.15.119:0/1392017687 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 0x7f9b1015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b15f1e640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 0x7f9b101467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 -- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 msgr2=0x7f9b101467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 0x7f9b101467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 -- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 msgr2=0x7f9b1015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 0x7f9b1015d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 -- 172.21.15.119:0/1392017687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b10151c60 con 0x7f9af8003f30 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 0x7f9b1015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:50.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b15f1e640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 0x7f9b101467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b1571d640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9b000079f0 tx=0x7f9b0000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00017020 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b00004e30 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b10151f40 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000ae60 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.060+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1014a8e0 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.061+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1014aae0 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.062+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b0001a020 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.062+0000 7f9b0dffb640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 0x7f9afc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.062+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f9b0008b7c0 con 0x7f9af8003f30 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.062+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 0x7f9afc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.063+0000 7f9b14f1c640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 0x7f9afc06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b04033000 tx=0x7f9b04008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.066+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b1014aae0 con 0x7f9af8003f30 2024-09-12T02:34:50.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.295+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f9b100ccfe0 con 0x7f9af8003f30 2024-09-12T02:34:50.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.297+0000 7f9b0dffb640 1 -- 172.21.15.119:0/1392017687 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f9b00021020 con 0x7f9af8003f30 2024-09-12T02:34:50.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 msgr2=0x7f9afc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 0x7f9afc06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b04033000 tx=0x7f9b04008030 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 msgr2=0x7f9b101515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9b000079f0 tx=0x7f9b0000a750 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 shutdown_connections 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9afc06be60 0x7f9afc06e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b10146360 0x7f9b101467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.299+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b10147590 0x7f9b1015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.300+0000 7f9b17981640 1 --2- 172.21.15.119:0/1392017687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9af8003f30 0x7f9b101515d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.300+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 >> 172.21.15.119:0/1392017687 conn(0x7f9b10067d70 msgr2=0x7f9b1006f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.300+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 shutdown_connections 2024-09-12T02:34:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.300+0000 7f9b17981640 1 -- 172.21.15.119:0/1392017687 wait complete. 2024-09-12T02:34:50.312 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:34:50.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.409+0000 7fc8ee4e4640 1 Processor -- start 2024-09-12T02:34:50.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.409+0000 7fc8ee4e4640 1 -- start start 2024-09-12T02:34:50.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8ee4e4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8e815e5f0 0x7fc8e80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8ee4e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8e80d3690 con 0x7fc8e80d30f0 2024-09-12T02:34:50.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8ee4e4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8e80d3970 con 0x7fc8e80b6690 2024-09-12T02:34:50.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8ee4e4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc8e806d530 con 0x7fc8e815e5f0 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e77fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc8e80d30f0 0x7fc8e80b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48230/0 (socket says 172.21.15.119:48230) 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e77fe640 1 -- 172.21.15.119:0/730123653 learned_addr learned my addr 172.21.15.119:0/730123653 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e7fff640 1 --2- 172.21.15.119:0/730123653 >> v2:172.21.15.153:3300/0 conn(0x7fc8e815e5f0 0x7fc8e80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960576579 0 0) 0x7fc8e80d3690 con 0x7fc8e80d30f0 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d0003520 con 0x7fc8e80d30f0 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454902962 0 0) 0x7fc8e80d3970 con 0x7fc8e80b6690 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.410+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e80d3690 con 0x7fc8e80b6690 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.411+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4250657315 0 0) 0x7fc8d0003520 con 0x7fc8e80d30f0 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.411+0000 7fc8e7fff640 1 -- 172.21.15.119:0/730123653 >> v1:172.21.15.153:6789/0 conn(0x7fc8e80b6690 legacy=0x7fc8e806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.411+0000 7fc8e7fff640 1 -- 172.21.15.119:0/730123653 >> v1:172.21.15.119:6789/0 conn(0x7fc8e80d30f0 legacy=0x7fc8e80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.411+0000 7fc8e7fff640 1 -- 172.21.15.119:0/730123653 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e806cee0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.411+0000 7fc8e7fff640 1 --2- 172.21.15.119:0/730123653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80d4dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80097d0 tx=0x7fc8d802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4140faf49d34f1b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8037070 con 0x7fc8e815e5f0 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d802ac90 con 0x7fc8e815e5f0 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8e6ffd640 1 -- 172.21.15.119:0/730123653 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc001670 con 0x7fc8e815e5f0 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/730123653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e815e5f0 msgr2=0x7fc8e80d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/730123653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80d4dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80097d0 tx=0x7fc8d802a200 comp rx=0 tx=0).stop 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/730123653 shutdown_connections 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/730123653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80d4dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/730123653 >> 172.21.15.119:0/730123653 conn(0x7fc8e808bfc0 msgr2=0x7fc8e80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/730123653 shutdown_connections 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.412+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/730123653 wait complete. 2024-09-12T02:34:50.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.413+0000 7fc8ee4e4640 1 Processor -- start 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 -- start start 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e80b6690 0x7fc8e81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e80d30f0 0x7fc8e80c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e80d5310 con 0x7fc8e815e5f0 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e815e9d0 con 0x7fc8e80d30f0 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8ee4e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc8e806e0d0 con 0x7fc8e80b6690 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8eca81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8eca81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46812/0 (socket says 172.21.15.119:46812) 2024-09-12T02:34:50.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.414+0000 7fc8eca81640 1 -- 172.21.15.119:0/3770167597 learned_addr learned my addr 172.21.15.119:0/3770167597 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8e7fff640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e80b6690 0x7fc8e81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8e77fe640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e80d30f0 0x7fc8e80c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 -- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e80b6690 msgr2=0x7fc8e81589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e80b6690 0x7fc8e81589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 -- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e80d30f0 msgr2=0x7fc8e80c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e80d30f0 0x7fc8e80c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 -- 172.21.15.119:0/3770167597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e80c8930 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8eca81640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c7a0 tx=0x7fc8e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0003b70 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0003d10 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e80c8c10 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e000aa90 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.415+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e80c91d0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.416+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e80d4dd0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.416+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8e000ac30 con 0x7fc8e815e5f0 2024-09-12T02:34:50.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.417+0000 7fc8e4ff9640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 0x7fc8d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.417+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fc8e008aba0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.417+0000 7fc8e7fff640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 0x7fc8d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.417+0000 7fc8e7fff640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 0x7fc8d406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8034000 tx=0x7fc8d802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.421+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8e00597a0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.590+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc8e80b2d00 con 0x7fc8e815e5f0 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.590+0000 7fc8e4ff9640 1 -- 172.21.15.119:0/3770167597 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7fc8e00590a0 con 0x7fc8e815e5f0 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:34:50.592 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2024-09-12T02:34:50.593 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2024-09-12T02:34:50.593 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:34:50.593 INFO:teuthology.orchestra.run.smithi119.stdout:] 2024-09-12T02:34:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 msgr2=0x7fc8d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 0x7fc8d406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8034000 tx=0x7fc8d802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 msgr2=0x7fc8e80c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c7a0 tx=0x7fc8e000cc60 comp rx=0 tx=0).stop 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 shutdown_connections 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc8d406be30 0x7fc8d406e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8e815e5f0 0x7fc8e80c9d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e80d30f0 0x7fc8e80c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 --2- 172.21.15.119:0/3770167597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e80b6690 0x7fc8e81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.592+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 >> 172.21.15.119:0/3770167597 conn(0x7fc8e808bfc0 msgr2=0x7fc8e806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.593+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 shutdown_connections 2024-09-12T02:34:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.593+0000 7fc8ee4e4640 1 -- 172.21.15.119:0/3770167597 wait complete. 2024-09-12T02:34:50.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:34:50.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:34:50.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.706+0000 7fed99952640 1 Processor -- start 2024-09-12T02:34:50.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.706+0000 7fed99952640 1 -- start start 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed99952640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed9415b360 0x7fed9406efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed99952640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed940b4c70 0x7fed940b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed99952640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9415c2b0 con 0x7fed940b41d0 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed99952640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fed940b5600 con 0x7fed9415b360 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed99952640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fed9415c590 con 0x7fed940b4c70 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed92ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed9415b360 0x7fed9406efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed92ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed9415b360 0x7fed9406efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46822/0 (socket says 172.21.15.119:46822) 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.707+0000 7fed92ffd640 1 -- 172.21.15.119:0/3435453768 learned_addr learned my addr 172.21.15.119:0/3435453768 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed92ffd640 1 -- 172.21.15.119:0/3435453768 >> v2:172.21.15.153:3300/0 conn(0x7fed940b4c70 msgr2=0x7fed940b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed92ffd640 1 --2- 172.21.15.119:0/3435453768 >> v2:172.21.15.153:3300/0 conn(0x7fed940b4c70 0x7fed940b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed92ffd640 1 -- 172.21.15.119:0/3435453768 >> v1:172.21.15.153:6789/0 conn(0x7fed940b41d0 legacy=0x7fed9415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed92ffd640 1 -- 172.21.15.119:0/3435453768 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940ae9a0 con 0x7fed9415b360 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed92ffd640 1 --2- 172.21.15.119:0/3435453768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9415b360 0x7fed9406efd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fed94068880 tx=0x7fed8402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebb9e85045ca1de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed91ffb640 1 -- 172.21.15.119:0/3435453768 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84036070 con 0x7fed9415b360 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.708+0000 7fed91ffb640 1 -- 172.21.15.119:0/3435453768 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed84031600 con 0x7fed9415b360 2024-09-12T02:34:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed91ffb640 1 -- 172.21.15.119:0/3435453768 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840319d0 con 0x7fed9415b360 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 -- 172.21.15.119:0/3435453768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9415b360 msgr2=0x7fed9406efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 --2- 172.21.15.119:0/3435453768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9415b360 0x7fed9406efd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fed94068880 tx=0x7fed8402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 -- 172.21.15.119:0/3435453768 shutdown_connections 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 --2- 172.21.15.119:0/3435453768 >> v2:172.21.15.153:3300/0 conn(0x7fed940b4c70 0x7fed940b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 --2- 172.21.15.119:0/3435453768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9415b360 0x7fed9406efd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 -- 172.21.15.119:0/3435453768 >> 172.21.15.119:0/3435453768 conn(0x7fed940b6680 msgr2=0x7fed940b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 -- 172.21.15.119:0/3435453768 shutdown_connections 2024-09-12T02:34:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.709+0000 7fed99952640 1 -- 172.21.15.119:0/3435453768 wait complete. 2024-09-12T02:34:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.710+0000 7fed99952640 1 Processor -- start 2024-09-12T02:34:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.710+0000 7fed99952640 1 -- start start 2024-09-12T02:34:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed940b41d0 0x7fed940cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed9415b360 0x7fed940cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed9406f510 con 0x7fed940b4c70 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed9415c870 con 0x7fed9415b360 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed99952640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed9406f690 con 0x7fed940b41d0 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46828/0 (socket says 172.21.15.119:46828) 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 -- 172.21.15.119:0/4223120393 learned_addr learned my addr 172.21.15.119:0/4223120393 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 -- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed940b41d0 msgr2=0x7fed940cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed940b41d0 0x7fed940cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 -- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed9415b360 msgr2=0x7fed940cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed9415b360 0x7fed940cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.711+0000 7fed927fc640 1 -- 172.21.15.119:0/4223120393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9409cc40 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed927fc640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00e6e0 tx=0x7fed7c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c015070 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c005290 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9409cf20 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c001940 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.712+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed940ce000 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.713+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed940b50c0 con 0x7fed940b4c70 2024-09-12T02:34:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.713+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed7c018070 con 0x7fed940b4c70 2024-09-12T02:34:50.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.714+0000 7fed8bfff640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 0x7fed7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:50.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.714+0000 7fed92ffd640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 0x7fed7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:50.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.714+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fed7c08cec0 con 0x7fed940b4c70 2024-09-12T02:34:50.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.714+0000 7fed92ffd640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 0x7fed7406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed84033000 tx=0x7fed8402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:50.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.718+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed7c05bac0 con 0x7fed940b4c70 2024-09-12T02:34:50.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:50.883+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fed940b7170 con 0x7fed940b4c70 2024-09-12T02:34:51.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.881+0000 7fed8bfff640 1 -- 172.21.15.119:0/4223120393 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7fed7c05b3c0 con 0x7fed940b4c70 2024-09-12T02:34:51.883 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 msgr2=0x7fed7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 0x7fed7406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed84033000 tx=0x7fed8402e000 comp rx=0 tx=0).stop 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 msgr2=0x7fed941598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00e6e0 tx=0x7fed7c00eba0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 shutdown_connections 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed7406be30 0x7fed7406e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed9415b360 0x7fed940cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940b4c70 0x7fed941598e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 --2- 172.21.15.119:0/4223120393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed940b41d0 0x7fed940cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 >> 172.21.15.119:0/4223120393 conn(0x7fed940b6680 msgr2=0x7fed9415e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:51.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.884+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 shutdown_connections 2024-09-12T02:34:51.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:51.885+0000 7fed99952640 1 -- 172.21.15.119:0/4223120393 wait complete. 2024-09-12T02:34:51.903 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:34:52.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.013+0000 7f0ece4f8640 1 Processor -- start 2024-09-12T02:34:52.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.013+0000 7f0ece4f8640 1 -- start start 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.013+0000 7f0ece4f8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ec8161a20 0x7f0ec80d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ece4f8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0ec80d1420 0x7f0ec80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ece4f8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec806e820 con 0x7f0ec80cf160 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ece4f8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec8161e00 con 0x7f0ec8161a20 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ece4f8640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec80d1830 con 0x7f0ec80d1420 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ec7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ec8161a20 0x7f0ec80d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ecca95640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0ec80cf160 0x7f0ec80b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48240/0 (socket says 172.21.15.119:48240) 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ecca95640 1 -- 172.21.15.119:0/2542679646 learned_addr learned my addr 172.21.15.119:0/2542679646 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:52.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ec7fff640 1 -- 172.21.15.119:0/2542679646 >> v2:172.21.15.153:3300/0 conn(0x7f0ec80d1420 msgr2=0x7f0ec80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:52.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ec7fff640 1 --2- 172.21.15.119:0/2542679646 >> v2:172.21.15.153:3300/0 conn(0x7f0ec80d1420 0x7f0ec80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ec7fff640 1 -- 172.21.15.119:0/2542679646 >> v1:172.21.15.119:6789/0 conn(0x7f0ec80cf160 legacy=0x7f0ec80b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.014+0000 7f0ec7fff640 1 -- 172.21.15.119:0/2542679646 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec80cf980 con 0x7f0ec8161a20 2024-09-12T02:34:52.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ec7fff640 1 --2- 172.21.15.119:0/2542679646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec8161a20 0x7f0ec80d0ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ec806c7d0 tx=0x7f0eb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3821eef017149e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ec6ffd640 1 -- 172.21.15.119:0/2542679646 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8037070 con 0x7f0ec8161a20 2024-09-12T02:34:52.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ec6ffd640 1 -- 172.21.15.119:0/2542679646 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb8032440 con 0x7f0ec8161a20 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ec6ffd640 1 -- 172.21.15.119:0/2542679646 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8032810 con 0x7f0ec8161a20 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 -- 172.21.15.119:0/2542679646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec8161a20 msgr2=0x7f0ec80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/2542679646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec8161a20 0x7f0ec80d0ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ec806c7d0 tx=0x7f0eb802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 -- 172.21.15.119:0/2542679646 shutdown_connections 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/2542679646 >> v2:172.21.15.153:3300/0 conn(0x7f0ec80d1420 0x7f0ec80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/2542679646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec8161a20 0x7f0ec80d0ee0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 -- 172.21.15.119:0/2542679646 >> 172.21.15.119:0/2542679646 conn(0x7f0ec809d850 msgr2=0x7f0ec808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 -- 172.21.15.119:0/2542679646 shutdown_connections 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.015+0000 7f0ece4f8640 1 -- 172.21.15.119:0/2542679646 wait complete. 2024-09-12T02:34:52.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 Processor -- start 2024-09-12T02:34:52.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 -- start start 2024-09-12T02:34:52.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ec80cf160 0x7f0ec81f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ec8161a20 0x7f0ec81f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec80cff00 con 0x7f0ec80d1420 2024-09-12T02:34:52.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec806d050 con 0x7f0ec8161a20 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.017+0000 7f0ece4f8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec806d2f0 con 0x7f0ec80cf160 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46840/0 (socket says 172.21.15.119:46840) 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 -- 172.21.15.119:0/1762017202 learned_addr learned my addr 172.21.15.119:0/1762017202 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ecca95640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ec8161a20 0x7f0ec81f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec7fff640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ec80cf160 0x7f0ec81f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 -- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ec80cf160 msgr2=0x7f0ec81f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ec80cf160 0x7f0ec81f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 -- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ec8161a20 msgr2=0x7f0ec81f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ec8161a20 0x7f0ec81f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 -- 172.21.15.119:0/1762017202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec80ca9c0 con 0x7f0ec80d1420 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec77fe640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00b4a0 tx=0x7f0ebc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc014070 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc010610 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec80ca6e0 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc010a00 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.018+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec80cbbc0 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.019+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec80b1040 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.020+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.020+0000 7f0ec4ff9640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 0x7f0eb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.020+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f0ebc08a700 con 0x7f0ec80d1420 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.020+0000 7f0ec7fff640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 0x7f0eb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.021+0000 7f0ec7fff640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 0x7f0eb406e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8034000 tx=0x7f0eb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.025+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ebc058b40 con 0x7f0ec80d1420 2024-09-12T02:34:52.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.193+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0ec8158910 con 0x7f0ec80d1420 2024-09-12T02:34:52.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.884+0000 7f0ec4ff9640 1 -- 172.21.15.119:0/1762017202 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f0ebc05ce40 con 0x7f0ec80d1420 2024-09-12T02:34:52.885 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2024-09-12T02:34:52.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 msgr2=0x7f0eb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 0x7f0eb406e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8034000 tx=0x7f0eb802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:52.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 msgr2=0x7f0ec80ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00b4a0 tx=0x7f0ebc00b960 comp rx=0 tx=0).stop 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 shutdown_connections 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f0eb406be60 0x7f0eb406e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ec8161a20 0x7f0ec81f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec80d1420 0x7f0ec80ce360 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 --2- 172.21.15.119:0/1762017202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ec80cf160 0x7f0ec81f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 >> 172.21.15.119:0/1762017202 conn(0x7f0ec809d850 msgr2=0x7f0ec80b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 shutdown_connections 2024-09-12T02:34:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:52.887+0000 7f0ece4f8640 1 -- 172.21.15.119:0/1762017202 wait complete. 2024-09-12T02:34:52.912 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:34:53.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.013+0000 7fed40ae6640 1 Processor -- start 2024-09-12T02:34:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.013+0000 7fed40ae6640 1 -- start start 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed40ae6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed3c141d70 0x7fed3c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed40ae6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c142200 con 0x7fed3c0b3c00 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed40ae6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c1424e0 con 0x7fed3c0afc40 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed40ae6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c142e10 con 0x7fed3c141d70 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed39d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed3c141d70 0x7fed3c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed3ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fed3c0b3c00 0x7fed3c1432a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48252/0 (socket says 172.21.15.119:48252) 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed39d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed3c141d70 0x7fed3c06f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46848/0 (socket says 172.21.15.119:46848) 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed3ad9d640 1 -- 172.21.15.119:0/2057189242 learned_addr learned my addr 172.21.15.119:0/2057189242 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed39d9b640 1 -- 172.21.15.119:0/2057189242 >> v1:172.21.15.153:6789/0 conn(0x7fed3c0afc40 legacy=0x7fed3c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed39d9b640 1 -- 172.21.15.119:0/2057189242 >> v1:172.21.15.119:6789/0 conn(0x7fed3c0b3c00 legacy=0x7fed3c1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed39d9b640 1 -- 172.21.15.119:0/2057189242 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c1427c0 con 0x7fed3c141d70 2024-09-12T02:34:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.014+0000 7fed3959a640 1 -- 172.21.15.119:0/2057189242 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349507960 0 0) 0x7fed3c142200 con 0x7fed3c0b3c00 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.015+0000 7fed39d9b640 1 --2- 172.21.15.119:0/2057189242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c141d70 0x7fed3c06f7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed3c142f90 tx=0x7fed3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c531eb678ea9db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.015+0000 7fed3959a640 1 -- 172.21.15.119:0/2057189242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30037070 con 0x7fed3c141d70 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.015+0000 7fed3959a640 1 -- 172.21.15.119:0/2057189242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30032440 con 0x7fed3c141d70 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.015+0000 7fed3959a640 1 -- 172.21.15.119:0/2057189242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30032810 con 0x7fed3c141d70 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 -- 172.21.15.119:0/2057189242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c141d70 msgr2=0x7fed3c06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 --2- 172.21.15.119:0/2057189242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c141d70 0x7fed3c06f7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed3c142f90 tx=0x7fed3002a210 comp rx=0 tx=0).stop 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 -- 172.21.15.119:0/2057189242 shutdown_connections 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 --2- 172.21.15.119:0/2057189242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c141d70 0x7fed3c06f7d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 -- 172.21.15.119:0/2057189242 >> 172.21.15.119:0/2057189242 conn(0x7fed3c073590 msgr2=0x7fed3c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 -- 172.21.15.119:0/2057189242 shutdown_connections 2024-09-12T02:34:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.016+0000 7fed40ae6640 1 -- 172.21.15.119:0/2057189242 wait complete. 2024-09-12T02:34:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.017+0000 7fed40ae6640 1 Processor -- start 2024-09-12T02:34:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.017+0000 7fed40ae6640 1 -- start start 2024-09-12T02:34:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed3c0afc40 0x7fed3c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed3c13c2e0 0x7fed3c1f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0b0020 con 0x7fed3c0b3c00 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c06fd10 con 0x7fed3c13c2e0 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed40ae6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c13c880 con 0x7fed3c0afc40 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46860/0 (socket says 172.21.15.119:46860) 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 -- 172.21.15.119:0/1612223818 learned_addr learned my addr 172.21.15.119:0/1612223818 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed3a59c640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed3c0afc40 0x7fed3c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed3ad9d640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed3c13c2e0 0x7fed3c1f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 -- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed3c0afc40 msgr2=0x7fed3c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed3c0afc40 0x7fed3c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 -- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed3c13c2e0 msgr2=0x7fed3c1f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed3c13c2e0 0x7fed3c1f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 -- 172.21.15.119:0/1612223818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c13cb60 con 0x7fed3c0b3c00 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.018+0000 7fed39d9b640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.019+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30040020 con 0x7fed3c0b3c00 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.019+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30038040 con 0x7fed3c0b3c00 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.019+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c13ce40 con 0x7fed3c0b3c00 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.019+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30037070 con 0x7fed3c0b3c00 2024-09-12T02:34:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.019+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c13d400 con 0x7fed3c0b3c00 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.020+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c070040 con 0x7fed3c0b3c00 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.020+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed30043020 con 0x7fed3c0b3c00 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.021+0000 7fed2affd640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 0x7fed1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.021+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7fed300ab560 con 0x7fed3c0b3c00 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.021+0000 7fed3a59c640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 0x7fed1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.021+0000 7fed3a59c640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 0x7fed1c06e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed2c000f60 tx=0x7fed2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.025+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed3004a030 con 0x7fed3c0b3c00 2024-09-12T02:34:53.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.230+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fed3c067ea0 con 0x7fed3c0b3c00 2024-09-12T02:34:53.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.907+0000 7fed2affd640 1 -- 172.21.15.119:0/1612223818 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fed30079790 con 0x7fed3c0b3c00 2024-09-12T02:34:53.908 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 5 and data pool 6 2024-09-12T02:34:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 msgr2=0x7fed1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 0x7fed1c06e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed2c000f60 tx=0x7fed2c009040 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 msgr2=0x7fed3c0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed300046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 shutdown_connections 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fed1c06be60 0x7fed1c06e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed3c13c2e0 0x7fed3c1f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed3c0b3c00 0x7fed3c0aee90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 --2- 172.21.15.119:0/1612223818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed3c0afc40 0x7fed3c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 >> 172.21.15.119:0/1612223818 conn(0x7fed3c073590 msgr2=0x7fed3c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 shutdown_connections 2024-09-12T02:34:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:53.913+0000 7fed40ae6640 1 -- 172.21.15.119:0/1612223818 wait complete. 2024-09-12T02:34:53.939 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.038+0000 7f38345e4640 1 Processor -- start 2024-09-12T02:34:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.038+0000 7f38345e4640 1 -- start start 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f38345e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 0x7f382c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f38345e4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f382c073050 0x7f382c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f38345e4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382c0b3570 con 0x7f382c06fd50 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f38345e4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f382c0b4180 con 0x7f382c073050 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f38345e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f382c0b3850 con 0x7f382c15ba30 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832b81640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f382c073050 0x7f382c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3831b7f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f382c06fd50 0x7f382c072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48258/0 (socket says 172.21.15.119:48258) 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3831b7f640 1 -- 172.21.15.119:0/310384162 learned_addr learned my addr 172.21.15.119:0/310384162 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832380640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 0x7f382c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832b81640 1 -- 172.21.15.119:0/310384162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 msgr2=0x7f382c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832b81640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 0x7f382c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832b81640 1 -- 172.21.15.119:0/310384162 >> v1:172.21.15.119:6789/0 conn(0x7f382c06fd50 legacy=0x7f382c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832b81640 1 -- 172.21.15.119:0/310384162 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c0b3b30 con 0x7f382c073050 2024-09-12T02:34:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.039+0000 7f3832380640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 0x7f382c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f3832b81640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c073050 0x7f382c0b4880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f382402b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637d3392d3968e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f383137e640 1 -- 172.21.15.119:0/310384162 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824037070 con 0x7f382c073050 2024-09-12T02:34:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f383137e640 1 -- 172.21.15.119:0/310384162 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3824007740 con 0x7f382c073050 2024-09-12T02:34:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f383137e640 1 -- 172.21.15.119:0/310384162 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824007b10 con 0x7f382c073050 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f38345e4640 1 -- 172.21.15.119:0/310384162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c073050 msgr2=0x7f382c0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.040+0000 7f38345e4640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c073050 0x7f382c0b4880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f382402b770 comp rx=0 tx=0).stop 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 -- 172.21.15.119:0/310384162 shutdown_connections 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c073050 0x7f382c0b4880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 --2- 172.21.15.119:0/310384162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c15ba30 0x7f382c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 -- 172.21.15.119:0/310384162 >> 172.21.15.119:0/310384162 conn(0x7f382c067d70 msgr2=0x7f382c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 -- 172.21.15.119:0/310384162 shutdown_connections 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.041+0000 7f38345e4640 1 -- 172.21.15.119:0/310384162 wait complete. 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 Processor -- start 2024-09-12T02:34:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 -- start start 2024-09-12T02:34:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c06fd50 0x7f382c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f382c073050 0x7f382c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0ccfe0 con 0x7f382c15ba30 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0ce810 con 0x7f382c073050 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.042+0000 7f38345e4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f382c0cd160 con 0x7f382c06fd50 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46872/0 (socket says 172.21.15.119:46872) 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 -- 172.21.15.119:0/4100354169 learned_addr learned my addr 172.21.15.119:0/4100354169 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832380640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c06fd50 0x7f382c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3831b7f640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f382c073050 0x7f382c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 -- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c06fd50 msgr2=0x7f382c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c06fd50 0x7f382c0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 -- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f382c073050 msgr2=0x7f382c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f382c073050 0x7f382c1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 -- 172.21.15.119:0/4100354169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c1f20b0 con 0x7f382c15ba30 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3832b81640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f3824004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824041020 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38240337c0 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824037040 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c1f2390 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.043+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c1f2c30 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.044+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c1f2780 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.045+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3824044020 con 0x7f382c15ba30 2024-09-12T02:34:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.045+0000 7f3822ffd640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 0x7f381006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.045+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f38240abcd0 con 0x7f382c15ba30 2024-09-12T02:34:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.045+0000 7f3832380640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 0x7f381006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.046+0000 7f3832380640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 0x7f381006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f382800a950 tx=0x7f3828008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.049+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f382404b030 con 0x7f382c15ba30 2024-09-12T02:34:54.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.216+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f382c1f2560 con 0x7f382c15ba30 2024-09-12T02:34:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.217+0000 7f3822ffd640 1 -- 172.21.15.119:0/4100354169 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17075 (secure 0 0 0) 0x7f382407a640 con 0x7f382c15ba30 2024-09-12T02:34:54.218 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:54.218 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":39,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:53.232171+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:50.903271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T02:34:52.212895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.219+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 msgr2=0x7f381006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.219+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 0x7f381006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f382800a950 tx=0x7f3828008040 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.219+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 msgr2=0x7f382c154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.219+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f3824004ab0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 shutdown_connections 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f381006be30 0x7f381006e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c15ba30 0x7f382c154970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f382c073050 0x7f382c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 --2- 172.21.15.119:0/4100354169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f382c06fd50 0x7f382c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 >> 172.21.15.119:0/4100354169 conn(0x7f382c067d70 msgr2=0x7f382c0b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 shutdown_connections 2024-09-12T02:34:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.220+0000 7f38345e4640 1 -- 172.21.15.119:0/4100354169 wait complete. 2024-09-12T02:34:54.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.329+0000 7f219ce1e640 1 Processor -- start 2024-09-12T02:34:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.329+0000 7f219ce1e640 1 -- start start 2024-09-12T02:34:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.330+0000 7f219ce1e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f219815b340 0x7f219809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.330+0000 7f219ce1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 0x7f21980b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.330+0000 7f219ce1e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21980b3830 con 0x7f21980b4e80 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.330+0000 7f219ce1e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f21980b5bd0 con 0x7f219815b340 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.330+0000 7f219ce1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21980b5610 con 0x7f21980b43f0 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f219815b340 0x7f219809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f2195d9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 0x7f21980b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f219815b340 0x7f219809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:49680/0 (socket says 172.21.15.119:49680) 2024-09-12T02:34:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 -- 172.21.15.119:0/2850495013 learned_addr learned my addr 172.21.15.119:0/2850495013 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f2195d9b640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 0x7f21980b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:44714/0 (socket says 172.21.15.119:44714) 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f2196d9d640 1 --1- 172.21.15.119:0/2850495013 >> v1:172.21.15.153:6789/0 conn(0x7f21980b4e80 0x7f219815de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:56600/0 (socket says 172.21.15.119:56600) 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 -- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 msgr2=0x7f21980b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 0x7f21980b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 -- 172.21.15.119:0/2850495013 >> v1:172.21.15.153:6789/0 conn(0x7f21980b4e80 legacy=0x7f219815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.331+0000 7f219659c640 1 -- 172.21.15.119:0/2850495013 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21980b58f0 con 0x7f219815b340 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219659c640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219815b340 0x7f219809aa30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2188009e50 tx=0x7f218802a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7943b432b3019a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219559a640 1 -- 172.21.15.119:0/2850495013 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188036070 con 0x7f219815b340 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219559a640 1 -- 172.21.15.119:0/2850495013 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2188031600 con 0x7f219815b340 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219559a640 1 -- 172.21.15.119:0/2850495013 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21880319d0 con 0x7f219815b340 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 -- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219815b340 msgr2=0x7f219809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219815b340 0x7f219809aa30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2188009e50 tx=0x7f218802a7a0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 -- 172.21.15.119:0/2850495013 shutdown_connections 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21980b43f0 0x7f21980b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 --2- 172.21.15.119:0/2850495013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219815b340 0x7f219809aa30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.332+0000 7f219ce1e640 1 -- 172.21.15.119:0/2850495013 >> 172.21.15.119:0/2850495013 conn(0x7f2198073490 msgr2=0x7f21980b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.333+0000 7f219ce1e640 1 -- 172.21.15.119:0/2850495013 shutdown_connections 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.333+0000 7f219ce1e640 1 -- 172.21.15.119:0/2850495013 wait complete. 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.334+0000 7f219ce1e640 1 Processor -- start 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.334+0000 7f219ce1e640 1 -- start start 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.334+0000 7f219ce1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21980b43f0 0x7f21981518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.334+0000 7f219ce1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.334+0000 7f219ce1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219815b340 0x7f219809d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219ce1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21980b5310 con 0x7f21980b4e80 2024-09-12T02:34:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219ce1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f219815d8f0 con 0x7f21980b43f0 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219ce1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f219815c730 con 0x7f219815b340 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46884/0 (socket says 172.21.15.119:46884) 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 -- 172.21.15.119:0/3630920554 learned_addr learned my addr 172.21.15.119:0/3630920554 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2196d9d640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219815b340 0x7f219809d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219659c640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21980b43f0 0x7f21981518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 -- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219815b340 msgr2=0x7f219809d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219815b340 0x7f219809d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 -- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21980b43f0 msgr2=0x7f21981518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21980b43f0 0x7f21981518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 -- 172.21.15.119:0/3630920554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21980b0620 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2195d9b640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f218c00e9e0 tx=0x7f218c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c017070 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c00c9d0 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21980b0900 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c00cdc0 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.335+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21980b0ec0 con 0x7f21980b4e80 2024-09-12T02:34:54.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.336+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21980ce2f0 con 0x7f21980b4e80 2024-09-12T02:34:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.337+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f218c01a070 con 0x7f21980b4e80 2024-09-12T02:34:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.337+0000 7f2186ffd640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 0x7f217806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.337+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f218c08b280 con 0x7f21980b4e80 2024-09-12T02:34:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.337+0000 7f219659c640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 0x7f217806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.338+0000 7f219659c640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 0x7f217806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2188033000 tx=0x7f2188009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.342+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f218c0594e0 con 0x7f21980b4e80 2024-09-12T02:34:54.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.505+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21980d0f70 con 0x7f21980b4e80 2024-09-12T02:34:54.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.506+0000 7f2186ffd640 1 -- 172.21.15.119:0/3630920554 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17075 (secure 0 0 0) 0x7f218c05d7e0 con 0x7f21980b4e80 2024-09-12T02:34:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:54.507 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":39,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:53.232171+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:50.903271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T02:34:52.212895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:54.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 msgr2=0x7f217806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 0x7f217806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2188033000 tx=0x7f2188009000 comp rx=0 tx=0).stop 2024-09-12T02:34:54.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 msgr2=0x7f21980b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f218c00e9e0 tx=0x7f218c00eea0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 shutdown_connections 2024-09-12T02:34:54.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f217806be30 0x7f217806e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219815b340 0x7f219809d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21980b4e80 0x7f21980b2320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.508+0000 7f219ce1e640 1 --2- 172.21.15.119:0/3630920554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21980b43f0 0x7f21981518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.509+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 >> 172.21.15.119:0/3630920554 conn(0x7f2198073490 msgr2=0x7f219806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.509+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 shutdown_connections 2024-09-12T02:34:54.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.509+0000 7f219ce1e640 1 -- 172.21.15.119:0/3630920554 wait complete. 2024-09-12T02:34:54.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:34:54.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.622+0000 7f89f2296640 1 Processor -- start 2024-09-12T02:34:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.622+0000 7f89f2296640 1 -- start start 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89f2296640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89ec0cd120 0x7f89ec071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89f2296640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ec073b20 con 0x7f89ec15b570 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89f2296640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ec073e00 con 0x7f89ec15b950 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89f2296640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f89ec0740e0 con 0x7f89ec0cd120 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89ebfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f89ec15b570 0x7f89ec0cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48274/0 (socket says 172.21.15.119:48274) 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89ebfff640 1 -- 172.21.15.119:0/2795310360 learned_addr learned my addr 172.21.15.119:0/2795310360 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89e3fff640 1 --2- 172.21.15.119:0/2795310360 >> v2:172.21.15.153:3300/0 conn(0x7f89ec0cd120 0x7f89ec071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89eb7fe640 1 -- 172.21.15.119:0/2795310360 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020389693 0 0) 0x7f89ec073b20 con 0x7f89ec15b570 2024-09-12T02:34:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89eb7fe640 1 -- 172.21.15.119:0/2795310360 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d8003520 con 0x7f89ec15b570 2024-09-12T02:34:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89e3fff640 1 -- 172.21.15.119:0/2795310360 >> v1:172.21.15.153:6789/0 conn(0x7f89ec15b950 legacy=0x7f89ec15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89e3fff640 1 -- 172.21.15.119:0/2795310360 >> v1:172.21.15.119:6789/0 conn(0x7f89ec15b570 legacy=0x7f89ec0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.623+0000 7f89e3fff640 1 -- 172.21.15.119:0/2795310360 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec0cf320 con 0x7f89ec0cd120 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.624+0000 7f89e3fff640 1 --2- 172.21.15.119:0/2795310360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec0cd120 0x7f89ec071e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89ec074260 tx=0x7f89d402b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1324044cf6c53d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.624+0000 7f89eb7fe640 1 -- 172.21.15.119:0/2795310360 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4038070 con 0x7f89ec0cd120 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.624+0000 7f89eb7fe640 1 -- 172.21.15.119:0/2795310360 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d4033640 con 0x7f89ec0cd120 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.624+0000 7f89eb7fe640 1 -- 172.21.15.119:0/2795310360 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40339f0 con 0x7f89ec0cd120 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 -- 172.21.15.119:0/2795310360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec0cd120 msgr2=0x7f89ec071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 --2- 172.21.15.119:0/2795310360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec0cd120 0x7f89ec071e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89ec074260 tx=0x7f89d402b3a0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 -- 172.21.15.119:0/2795310360 shutdown_connections 2024-09-12T02:34:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 --2- 172.21.15.119:0/2795310360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec0cd120 0x7f89ec071e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 -- 172.21.15.119:0/2795310360 >> 172.21.15.119:0/2795310360 conn(0x7f89ec06bdf0 msgr2=0x7f89ec06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 -- 172.21.15.119:0/2795310360 shutdown_connections 2024-09-12T02:34:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.625+0000 7f89f2296640 1 -- 172.21.15.119:0/2795310360 wait complete. 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.626+0000 7f89f2296640 1 Processor -- start 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.626+0000 7f89f2296640 1 -- start start 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89ec0cd120 0x7f89ec1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec15b950 0x7f89ec15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec0cf840 con 0x7f89ec15b570 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec072450 con 0x7f89ec15b950 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f2296640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec0cf9c0 con 0x7f89ec0cd120 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46892/0 (socket says 172.21.15.119:46892) 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 -- 172.21.15.119:0/3172790171 learned_addr learned my addr 172.21.15.119:0/3172790171 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89ebfff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89ec0cd120 0x7f89ec1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89f0833640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec15b950 0x7f89ec15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 -- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89ec0cd120 msgr2=0x7f89ec1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89ec0cd120 0x7f89ec1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 -- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec15b950 msgr2=0x7f89ec15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec15b950 0x7f89ec15e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 -- 172.21.15.119:0/3172790171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec156860 con 0x7f89ec15b570 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e3fff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4038040 con 0x7f89ec15b570 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.627+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d4004030 con 0x7f89ec15b570 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.628+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4006e10 con 0x7f89ec15b570 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.628+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec14fd60 con 0x7f89ec15b570 2024-09-12T02:34:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.628+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec156dc0 con 0x7f89ec15b570 2024-09-12T02:34:54.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.629+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec071e40 con 0x7f89ec15b570 2024-09-12T02:34:54.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.629+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89d4031770 con 0x7f89ec15b570 2024-09-12T02:34:54.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.629+0000 7f89e97fa640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 0x7f89cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:54.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.629+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f89d40abad0 con 0x7f89ec15b570 2024-09-12T02:34:54.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.629+0000 7f89ebfff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 0x7f89cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:54.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.630+0000 7f89ebfff640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 0x7f89cc06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0011e0 tx=0x7f89dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:54.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.634+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89ec156860 con 0x7f89ec15b570 2024-09-12T02:34:54.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.832+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f89ec0af470 con 0x7f89ec15b570 2024-09-12T02:34:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.913+0000 7f89e97fa640 1 -- 172.21.15.119:0/3172790171 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f89d407a390 con 0x7f89ec15b570 2024-09-12T02:34:54.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 msgr2=0x7f89cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 0x7f89cc06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0011e0 tx=0x7f89dc009040 comp rx=0 tx=0).stop 2024-09-12T02:34:54.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 msgr2=0x7f89ec14d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:54.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 shutdown_connections 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f89cc06be30 0x7f89cc06e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ec15b950 0x7f89ec15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89ec15b570 0x7f89ec14d410 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 --2- 172.21.15.119:0/3172790171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89ec0cd120 0x7f89ec1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 >> 172.21.15.119:0/3172790171 conn(0x7f89ec06bdf0 msgr2=0x7f89ec151850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 shutdown_connections 2024-09-12T02:34:54.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:54.916+0000 7f89f2296640 1 -- 172.21.15.119:0/3172790171 wait complete. 2024-09-12T02:34:54.928 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:34:54.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:34:55.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.030+0000 7f39ff6c0640 1 Processor -- start 2024-09-12T02:34:55.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.030+0000 7f39ff6c0640 1 -- start start 2024-09-12T02:34:55.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39ff6c0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39f8070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39ff6c0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f806cdc0 con 0x7f39f815e7f0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39ff6c0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f806d0a0 con 0x7f39f8070fb0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39ff6c0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39f806d380 con 0x7f39f80af210 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39fd45c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f39f815e7f0 0x7f39f80b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48282/0 (socket says 172.21.15.119:48282) 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39fd45c640 1 -- 172.21.15.119:0/1970366477 learned_addr learned my addr 172.21.15.119:0/1970366477 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39fcc5b640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39f8070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270147293 0 0) 0x7f39f806cdc0 con 0x7f39f815e7f0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.031+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e4003520 con 0x7f39f815e7f0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209779560 0 0) 0x7f39e4003520 con 0x7f39f815e7f0 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 msgr2=0x7f39f8070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39f8070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 >> v1:172.21.15.153:6789/0 conn(0x7f39f8070fb0 legacy=0x7f39f806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f806d660 con 0x7f39f815e7f0 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f39f4001670 con 0x7f39f815e7f0 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 >> v1:172.21.15.119:6789/0 conn(0x7f39f815e7f0 legacy=0x7f39f80b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39e40039e0 0x7f39e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39f806d380 con 0x7f39e4004d40 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400b9c0 con 0x7f39e40039e0 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39e400bbc0 con 0x7f39f80af210 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fd45c640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39e40039e0 0x7f39e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fcc5b640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 -- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 msgr2=0x7f39e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80af210 0x7f39e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 -- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39e40039e0 msgr2=0x7f39e4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39e40039e0 0x7f39e4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.032+0000 7f39fdc5d640 1 -- 172.21.15.119:0/1970366477 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e4003520 con 0x7f39e4004d40 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.033+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39e40051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39f0001f60 tx=0x7f39e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763831f56dd0d2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.033+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0001b30 con 0x7f39e4004d40 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.033+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0031620 con 0x7f39e4004d40 2024-09-12T02:34:55.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.033+0000 7f39effff640 1 -- 172.21.15.119:0/1970366477 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0031a10 con 0x7f39e4004d40 2024-09-12T02:34:55.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.033+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1970366477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 msgr2=0x7f39e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1970366477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39e40051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39f0001f60 tx=0x7f39e4005830 comp rx=0 tx=0).stop 2024-09-12T02:34:55.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39fdc5d640 1 -- 172.21.15.119:0/1970366477 reap_dead start 2024-09-12T02:34:55.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1970366477 shutdown_connections 2024-09-12T02:34:55.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1970366477 >> 172.21.15.119:0/1970366477 conn(0x7f39f80b3f30 msgr2=0x7f39f80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:55.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1970366477 shutdown_connections 2024-09-12T02:34:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.034+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1970366477 wait complete. 2024-09-12T02:34:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.035+0000 7f39ff6c0640 1 Processor -- start 2024-09-12T02:34:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.035+0000 7f39ff6c0640 1 -- start start 2024-09-12T02:34:55.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f8161280 0x7f39f814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 0x7f39f814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80b60c0 con 0x7f39e4004d40 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80b5f40 con 0x7f39f8161280 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39f8070a70 con 0x7f39f814c5f0 2024-09-12T02:34:55.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46898/0 (socket says 172.21.15.119:46898) 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 -- 172.21.15.119:0/1922920495 learned_addr learned my addr 172.21.15.119:0/1922920495 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fcc5b640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f8161280 0x7f39f814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 0x7f39f814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 -- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 msgr2=0x7f39f814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 0x7f39f814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 -- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f8161280 msgr2=0x7f39f814bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f8161280 0x7f39f814bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 -- 172.21.15.119:0/1922920495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f814c310 con 0x7f39e4004d40 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fdc5d640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 0x7f39f814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39fd45c640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39f40073a0 tx=0x7f39f40077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:55.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f401a070 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f400f9c0 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f809c9b0 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f400fd70 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.036+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f809cf70 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.037+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f8068dc0 con 0x7f39e4004d40 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.038+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39f401d070 con 0x7f39e4004d40 2024-09-12T02:34:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.038+0000 7f39edffb640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 0x7f39dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.038+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f39f408aaa0 con 0x7f39e4004d40 2024-09-12T02:34:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.038+0000 7f39fcc5b640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 0x7f39dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.039+0000 7f39fcc5b640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 0x7f39dc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f39f81f79e0 tx=0x7f39e8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.043+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39f8068dc0 con 0x7f39e4004d40 2024-09-12T02:34:55.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.243+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f39f80b6d10 con 0x7f39e4004d40 2024-09-12T02:34:55.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.918+0000 7f39edffb640 1 -- 172.21.15.119:0/1922920495 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f39f814c310 con 0x7f39e4004d40 2024-09-12T02:34:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 msgr2=0x7f39dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 0x7f39dc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f39f81f79e0 tx=0x7f39e8009190 comp rx=0 tx=0).stop 2024-09-12T02:34:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 msgr2=0x7f39f809c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39f40073a0 tx=0x7f39f40077a0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 shutdown_connections 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f39dc06be30 0x7f39dc06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f814c5f0 0x7f39f814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f8161280 0x7f39f814bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 --2- 172.21.15.119:0/1922920495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e4004d40 0x7f39f809c320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.920+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 >> 172.21.15.119:0/1922920495 conn(0x7f39f80b3f30 msgr2=0x7f39f809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.921+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 shutdown_connections 2024-09-12T02:34:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:55.921+0000 7f39ff6c0640 1 -- 172.21.15.119:0/1922920495 wait complete. 2024-09-12T02:34:55.933 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:34:55.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:56.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.033+0000 7fdb602f1640 1 Processor -- start 2024-09-12T02:34:56.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.033+0000 7fdb602f1640 1 -- start start 2024-09-12T02:34:56.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 0x7fdb58070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb58070dd0 0x7fdb580d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 0x7fdb5806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5806cb30 con 0x7fdb58070dd0 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb580d0e50 con 0x7fdb58147360 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb602f1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5806bfb0 con 0x7fdb580d09e0 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb58070dd0 0x7fdb580d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb58070dd0 0x7fdb580d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46900/0 (socket says 172.21.15.119:46900) 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 -- 172.21.15.119:0/375982060 learned_addr learned my addr 172.21.15.119:0/375982060 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5e88e640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 0x7fdb5806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 -- 172.21.15.119:0/375982060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 msgr2=0x7fdb5806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5e08d640 1 --2- 172.21.15.119:0/375982060 >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 0x7fdb58070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 0x7fdb5806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 -- 172.21.15.119:0/375982060 >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 msgr2=0x7fdb58070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/375982060 >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 0x7fdb58070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5d88c640 1 -- 172.21.15.119:0/375982060 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5806c290 con 0x7fdb58070dd0 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5e88e640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 0x7fdb5806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.034+0000 7fdb5e08d640 1 --2- 172.21.15.119:0/375982060 >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 0x7fdb58070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.035+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb58070dd0 0x7fdb580d04a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb581483f0 tx=0x7fdb4802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4508d8c0fb7ab833 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.035+0000 7fdb5d08b640 1 -- 172.21.15.119:0/375982060 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48037070 con 0x7fdb58070dd0 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.035+0000 7fdb5d08b640 1 -- 172.21.15.119:0/375982060 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48032440 con 0x7fdb58070dd0 2024-09-12T02:34:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.035+0000 7fdb5d08b640 1 -- 172.21.15.119:0/375982060 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48032810 con 0x7fdb58070dd0 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 -- 172.21.15.119:0/375982060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb58070dd0 msgr2=0x7fdb580d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb58070dd0 0x7fdb580d04a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb581483f0 tx=0x7fdb4802a140 comp rx=0 tx=0).stop 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 -- 172.21.15.119:0/375982060 shutdown_connections 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb580d09e0 0x7fdb5806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 --2- 172.21.15.119:0/375982060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb58070dd0 0x7fdb580d04a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 --2- 172.21.15.119:0/375982060 >> v2:172.21.15.153:3300/0 conn(0x7fdb58147360 0x7fdb58070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 -- 172.21.15.119:0/375982060 >> 172.21.15.119:0/375982060 conn(0x7fdb580b2f40 msgr2=0x7fdb580b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 -- 172.21.15.119:0/375982060 shutdown_connections 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.036+0000 7fdb602f1640 1 -- 172.21.15.119:0/375982060 wait complete. 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 Processor -- start 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 -- start start 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb58070dd0 0x7fdb58141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58147360 0x7fdb580b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5806bc10 con 0x7fdb580d09e0 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5806c850 con 0x7fdb58147360 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.037+0000 7fdb602f1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5806bd90 con 0x7fdb58070dd0 2024-09-12T02:34:56.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46916/0 (socket says 172.21.15.119:46916) 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 -- 172.21.15.119:0/1782941842 learned_addr learned my addr 172.21.15.119:0/1782941842 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5e88e640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58147360 0x7fdb580b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5e08d640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb58070dd0 0x7fdb58141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 -- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb58070dd0 msgr2=0x7fdb58141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb58070dd0 0x7fdb58141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 -- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58147360 msgr2=0x7fdb580b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58147360 0x7fdb580b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 -- 172.21.15.119:0/1782941842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb58141a40 con 0x7fdb580d09e0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb5d88c640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb4802a180 tx=0x7fdb480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48037040 con 0x7fdb580d09e0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48042070 con 0x7fdb580d09e0 2024-09-12T02:34:56.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb580b54b0 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48030bb0 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.038+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb580b5a70 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.039+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb580d04a0 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.040+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb48047460 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.040+0000 7fdb4effd640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.040+0000 7fdb5e08d640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.040+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdb480abc20 con 0x7fdb580d09e0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.041+0000 7fdb5e08d640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb54008850 tx=0x7fdb54008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.045+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb48045360 con 0x7fdb580d09e0 2024-09-12T02:34:56.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.244+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb580cea50 con 0x7fdb580d09e0 2024-09-12T02:34:56.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.244+0000 7fdb4effd640 1 -- 172.21.15.119:0/1782941842 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7fdb4807a440 con 0x7fdb580d09e0 2024-09-12T02:34:56.245 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:56.245 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:34:56.245 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:34:56.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 msgr2=0x7fdb3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb54008850 tx=0x7fdb54008040 comp rx=0 tx=0).stop 2024-09-12T02:34:56.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 msgr2=0x7fdb58144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb4802a180 tx=0x7fdb480046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 shutdown_connections 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58147360 0x7fdb580b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb580d09e0 0x7fdb58144fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 --2- 172.21.15.119:0/1782941842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb58070dd0 0x7fdb58141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 >> 172.21.15.119:0/1782941842 conn(0x7fdb580b2f40 msgr2=0x7fdb580b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 shutdown_connections 2024-09-12T02:34:56.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.246+0000 7fdb602f1640 1 -- 172.21.15.119:0/1782941842 wait complete. 2024-09-12T02:34:56.258 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:34:56.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.357+0000 7fc4f94ae640 1 Processor -- start 2024-09-12T02:34:56.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.357+0000 7fc4f94ae640 1 -- start start 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f94ae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f415c520 0x7fc4f409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f94ae640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f94ae640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f40cec00 con 0x7fc4f40b1620 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f94ae640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f409bd90 con 0x7fc4f415c520 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f94ae640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f40d0010 con 0x7fc4f40d1090 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f415c520 0x7fc4f409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f415c520 0x7fc4f409b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46932/0 (socket says 172.21.15.119:46932) 2024-09-12T02:34:56.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.358+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/2455003335 learned_addr learned my addr 172.21.15.119:0/2455003335 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/2455003335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 msgr2=0x7fc4f40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f2ffd640 1 --2- 172.21.15.119:0/2455003335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/2455003335 >> v1:172.21.15.153:6789/0 conn(0x7fc4f40b1620 legacy=0x7fc4f40d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/2455003335 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f40d02f0 con 0x7fc4f415c520 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f2ffd640 1 --2- 172.21.15.119:0/2455003335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f415c520 0x7fc4f409b720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009870 tx=0x7fc4e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7d16701ea72e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f1ffb640 1 -- 172.21.15.119:0/2455003335 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4037070 con 0x7fc4f415c520 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.359+0000 7fc4f1ffb640 1 -- 172.21.15.119:0/2455003335 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4032440 con 0x7fc4f415c520 2024-09-12T02:34:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f1ffb640 1 -- 172.21.15.119:0/2455003335 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4032810 con 0x7fc4f415c520 2024-09-12T02:34:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 -- 172.21.15.119:0/2455003335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f415c520 msgr2=0x7fc4f409b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/2455003335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f415c520 0x7fc4f409b720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009870 tx=0x7fc4e402a210 comp rx=0 tx=0).stop 2024-09-12T02:34:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 -- 172.21.15.119:0/2455003335 shutdown_connections 2024-09-12T02:34:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/2455003335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/2455003335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f415c520 0x7fc4f409b720 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 -- 172.21.15.119:0/2455003335 >> 172.21.15.119:0/2455003335 conn(0x7fc4f40d23a0 msgr2=0x7fc4f40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 -- 172.21.15.119:0/2455003335 shutdown_connections 2024-09-12T02:34:56.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.360+0000 7fc4f94ae640 1 -- 172.21.15.119:0/2455003335 wait complete. 2024-09-12T02:34:56.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.361+0000 7fc4f94ae640 1 Processor -- start 2024-09-12T02:34:56.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.361+0000 7fc4f94ae640 1 -- start start 2024-09-12T02:34:56.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f415c520 0x7fc4f40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f415c900 con 0x7fc4f40b1620 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f40d05d0 con 0x7fc4f415c520 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f94ae640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f40cbb40 con 0x7fc4f40d1090 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46940/0 (socket says 172.21.15.119:46940) 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/1643195649 learned_addr learned my addr 172.21.15.119:0/1643195649 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 msgr2=0x7fc4f40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f415c520 msgr2=0x7fc4f40cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f415c520 0x7fc4f40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.362+0000 7fc4f2ffd640 1 -- 172.21.15.119:0/1643195649 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f40ca560 con 0x7fc4f40b1620 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4f2ffd640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009870 tx=0x7fc4e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4041070 con 0x7fc4f40b1620 2024-09-12T02:34:56.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e403c870 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4037040 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f40ca840 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.363+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f40cae00 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.364+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f40b1d40 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.364+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4e4044070 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.365+0000 7fc4db7fe640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 0x7fc4e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.365+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc4e40abcf0 con 0x7fc4f40b1620 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.365+0000 7fc4f27fc640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 0x7fc4e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.365+0000 7fc4f27fc640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 0x7fc4e006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40b1300 tx=0x7fc4e8007990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.369+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4e40b0070 con 0x7fc4f40b1620 2024-09-12T02:34:56.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.534+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f40b8320 con 0x7fc4f40b1620 2024-09-12T02:34:56.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.535+0000 7fc4db7fe640 1 -- 172.21.15.119:0/1643195649 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7fc4e407a630 con 0x7fc4f40b1620 2024-09-12T02:34:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:56.537 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":40,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:54.908247+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:50.903271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T02:34:52.212895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.537+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 msgr2=0x7fc4e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.537+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 0x7fc4e006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40b1300 tx=0x7fc4e8007990 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.537+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 msgr2=0x7fc4f4155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009870 tx=0x7fc4e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 shutdown_connections 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc4e006be30 0x7fc4e006e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f415c520 0x7fc4f40cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4f40d1090 0x7fc4f40cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 --2- 172.21.15.119:0/1643195649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f40b1620 0x7fc4f4155900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 >> 172.21.15.119:0/1643195649 conn(0x7fc4f40d23a0 msgr2=0x7fc4f40b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 shutdown_connections 2024-09-12T02:34:56.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.538+0000 7fc4f94ae640 1 -- 172.21.15.119:0/1643195649 wait complete. 2024-09-12T02:34:56.550 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:34:56.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:56.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.648+0000 7f67c5c17640 1 Processor -- start 2024-09-12T02:34:56.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.648+0000 7f67c5c17640 1 -- start start 2024-09-12T02:34:56.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67c5c17640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67c0072de0 0x7f67c015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67c5c17640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67c0072700 0x7f67c015d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67c5c17640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c0146140 con 0x7f67c0072320 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67c5c17640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f67c00cd740 con 0x7f67c0072700 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67c5c17640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f67c00cda20 con 0x7f67c0072de0 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67c0072700 0x7f67c015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67c0072700 0x7f67c015d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46942/0 (socket says 172.21.15.119:46942) 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 -- 172.21.15.119:0/4270794629 learned_addr learned my addr 172.21.15.119:0/4270794629 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67beffd640 1 --2- 172.21.15.119:0/4270794629 >> v2:172.21.15.153:3300/0 conn(0x7f67c0072de0 0x7f67c015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 -- 172.21.15.119:0/4270794629 >> v2:172.21.15.153:3300/0 conn(0x7f67c0072de0 msgr2=0x7f67c015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 --2- 172.21.15.119:0/4270794629 >> v2:172.21.15.153:3300/0 conn(0x7f67c0072de0 0x7f67c015d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 -- 172.21.15.119:0/4270794629 >> v1:172.21.15.153:6789/0 conn(0x7f67c0072320 legacy=0x7f67c00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.649+0000 7f67bffff640 1 -- 172.21.15.119:0/4270794629 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c00cdd00 con 0x7f67c0072700 2024-09-12T02:34:56.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67bffff640 1 --2- 172.21.15.119:0/4270794629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072700 0x7f67c015d720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67c006f8c0 tx=0x7f67b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd46a9045ef1129 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67be7fc640 1 -- 172.21.15.119:0/4270794629 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8036070 con 0x7f67c0072700 2024-09-12T02:34:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67be7fc640 1 -- 172.21.15.119:0/4270794629 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b8031600 con 0x7f67c0072700 2024-09-12T02:34:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67be7fc640 1 -- 172.21.15.119:0/4270794629 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80319d0 con 0x7f67c0072700 2024-09-12T02:34:56.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 -- 172.21.15.119:0/4270794629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072700 msgr2=0x7f67c015d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 --2- 172.21.15.119:0/4270794629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072700 0x7f67c015d720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67c006f8c0 tx=0x7f67b802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 -- 172.21.15.119:0/4270794629 shutdown_connections 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 --2- 172.21.15.119:0/4270794629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072700 0x7f67c015d720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 --2- 172.21.15.119:0/4270794629 >> v2:172.21.15.153:3300/0 conn(0x7f67c0072de0 0x7f67c015d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.650+0000 7f67c5c17640 1 -- 172.21.15.119:0/4270794629 >> 172.21.15.119:0/4270794629 conn(0x7f67c0067d70 msgr2=0x7f67c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.651+0000 7f67c5c17640 1 -- 172.21.15.119:0/4270794629 shutdown_connections 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.651+0000 7f67c5c17640 1 -- 172.21.15.119:0/4270794629 wait complete. 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.652+0000 7f67c5c17640 1 Processor -- start 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.652+0000 7f67c5c17640 1 -- start start 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.652+0000 7f67c5c17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.652+0000 7f67c5c17640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67c0072700 0x7f67c00b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c0072de0 0x7f67c01f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67c015dde0 con 0x7f67c0072320 2024-09-12T02:34:56.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67c015dc60 con 0x7f67c0072de0 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67c015df60 con 0x7f67c0072700 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46948/0 (socket says 172.21.15.119:46948) 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 -- 172.21.15.119:0/1400032879 learned_addr learned my addr 172.21.15.119:0/1400032879 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67beffd640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67c0072700 0x7f67c00b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bffff640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c0072de0 0x7f67c01f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 -- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67c0072700 msgr2=0x7f67c00b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67c0072700 0x7f67c00b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 -- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c0072de0 msgr2=0x7f67c01f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c0072de0 0x7f67c01f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 -- 172.21.15.119:0/1400032879 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c01f5f20 con 0x7f67c0072320 2024-09-12T02:34:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67bf7fe640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c400 tx=0x7f67b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b40052d0 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b4005490 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4007260 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c01f6200 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.653+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c01f2440 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.654+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c015e320 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.655+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67b4007400 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.655+0000 7f67a7fff640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 0x7f67ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.655+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f67b408a480 con 0x7f67c0072320 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.655+0000 7f67beffd640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 0x7f67ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.656+0000 7f67beffd640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 0x7f67ac06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f67c01efbb0 tx=0x7f67b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.659+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b4058650 con 0x7f67c0072320 2024-09-12T02:34:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.822+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67c0145910 con 0x7f67ac06be30 2024-09-12T02:34:56.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.827+0000 7f67a7fff640 1 -- 172.21.15.119:0/1400032879 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243655 (secure 0 0 0) 0x7f67c0145910 con 0x7f67ac06be30 2024-09-12T02:34:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:56.834 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:56.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 msgr2=0x7f67ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 0x7f67ac06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f67c01efbb0 tx=0x7f67b0008040 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 msgr2=0x7f67c01f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c400 tx=0x7f67b400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 shutdown_connections 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f67ac06be30 0x7f67ac06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c0072de0 0x7f67c01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67c0072700 0x7f67c00b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 --2- 172.21.15.119:0/1400032879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67c0072320 0x7f67c01f2960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.830+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 >> 172.21.15.119:0/1400032879 conn(0x7f67c0067d70 msgr2=0x7f67c00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.831+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 shutdown_connections 2024-09-12T02:34:56.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.831+0000 7f67c5c17640 1 -- 172.21.15.119:0/1400032879 wait complete. 2024-09-12T02:34:56.842 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T02:34:55.190714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":220652,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754068,"statfs":{"total":773094113280,"available":772868165632,"internally_reserved":0,"allocated":4513792,"data_stored":2595067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000562"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894314+0000","last_change":"2024-09-12T02:34:52.894314+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894314+0000","last_undegraded":"2024-09-12T02:34:52.894314+0000","last_fullsized":"2024-09-12T02:34:52.894314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892289+0000","last_change":"2024-09-12T02:34:52.892289+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892289+0000","last_undegraded":"2024-09-12T02:34:52.892289+0000","last_fullsized":"2024-09-12T02:34:52.892289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.927110+0000","last_change":"2024-09-12T02:34:53.925071+0000","last_active":"2024-09-12T02:34:53.927110+0000","last_peered":"2024-09-12T02:34:53.927110+0000","last_clean":"2024-09-12T02:34:53.927110+0000","last_became_active":"2024-09-12T02:34:53.924546+0000","last_became_peered":"2024-09-12T02:34:53.924546+0000","last_unstale":"2024-09-12T02:34:53.927110+0000","last_undegraded":"2024-09-12T02:34:53.927110+0000","last_fullsized":"2024-09-12T02:34:53.927110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928050+0000","last_change":"2024-09-12T02:34:53.926491+0000","last_active":"2024-09-12T02:34:53.928050+0000","last_peered":"2024-09-12T02:34:53.928050+0000","last_clean":"2024-09-12T02:34:53.928050+0000","last_became_active":"2024-09-12T02:34:53.926211+0000","last_became_peered":"2024-09-12T02:34:53.926211+0000","last_unstale":"2024-09-12T02:34:53.928050+0000","last_undegraded":"2024-09-12T02:34:53.928050+0000","last_fullsized":"2024-09-12T02:34:53.928050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.893487+0000","last_change":"2024-09-12T02:34:52.893487+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.893487+0000","last_undegraded":"2024-09-12T02:34:52.893487+0000","last_fullsized":"2024-09-12T02:34:52.893487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926607+0000","last_change":"2024-09-12T02:34:53.922929+0000","last_active":"2024-09-12T02:34:53.926607+0000","last_peered":"2024-09-12T02:34:53.926607+0000","last_clean":"2024-09-12T02:34:53.926607+0000","last_became_active":"2024-09-12T02:34:53.922520+0000","last_became_peered":"2024-09-12T02:34:53.922520+0000","last_unstale":"2024-09-12T02:34:53.926607+0000","last_undegraded":"2024-09-12T02:34:53.926607+0000","last_fullsized":"2024-09-12T02:34:53.926607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922349+0000","last_change":"2024-09-12T02:34:53.916964+0000","last_active":"2024-09-12T02:34:53.922349+0000","last_peered":"2024-09-12T02:34:53.922349+0000","last_clean":"2024-09-12T02:34:53.922349+0000","last_became_active":"2024-09-12T02:34:53.916680+0000","last_became_peered":"2024-09-12T02:34:53.916680+0000","last_unstale":"2024-09-12T02:34:53.922349+0000","last_undegraded":"2024-09-12T02:34:53.922349+0000","last_fullsized":"2024-09-12T02:34:53.922349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914563+0000","last_change":"2024-09-12T02:34:53.907701+0000","last_active":"2024-09-12T02:34:53.914563+0000","last_peered":"2024-09-12T02:34:53.914563+0000","last_clean":"2024-09-12T02:34:53.914563+0000","last_became_active":"2024-09-12T02:34:53.907425+0000","last_became_peered":"2024-09-12T02:34:53.907425+0000","last_unstale":"2024-09-12T02:34:53.914563+0000","last_undegraded":"2024-09-12T02:34:53.914563+0000","last_fullsized":"2024-09-12T02:34:53.914563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:21.915931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914760+0000","last_change":"2024-09-12T02:34:53.908746+0000","last_active":"2024-09-12T02:34:53.914760+0000","last_peered":"2024-09-12T02:34:53.914760+0000","last_clean":"2024-09-12T02:34:53.914760+0000","last_became_active":"2024-09-12T02:34:53.908484+0000","last_became_peered":"2024-09-12T02:34:53.908484+0000","last_unstale":"2024-09-12T02:34:53.914760+0000","last_undegraded":"2024-09-12T02:34:53.914760+0000","last_fullsized":"2024-09-12T02:34:53.914760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:03.587388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923956+0000","last_change":"2024-09-12T02:34:53.920936+0000","last_active":"2024-09-12T02:34:53.923956+0000","last_peered":"2024-09-12T02:34:53.923956+0000","last_clean":"2024-09-12T02:34:53.923956+0000","last_became_active":"2024-09-12T02:34:53.920663+0000","last_became_peered":"2024-09-12T02:34:53.920663+0000","last_unstale":"2024-09-12T02:34:53.923956+0000","last_undegraded":"2024-09-12T02:34:53.923956+0000","last_fullsized":"2024-09-12T02:34:53.923956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:39.371309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933174+0000","last_change":"2024-09-12T02:34:53.931129+0000","last_active":"2024-09-12T02:34:53.933174+0000","last_peered":"2024-09-12T02:34:53.933174+0000","last_clean":"2024-09-12T02:34:53.933174+0000","last_became_active":"2024-09-12T02:34:53.930795+0000","last_became_peered":"2024-09-12T02:34:53.930795+0000","last_unstale":"2024-09-12T02:34:53.933174+0000","last_undegraded":"2024-09-12T02:34:53.933174+0000","last_fullsized":"2024-09-12T02:34:53.933174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922936+0000","last_change":"2024-09-12T02:34:53.919417+0000","last_active":"2024-09-12T02:34:53.922936+0000","last_peered":"2024-09-12T02:34:53.922936+0000","last_clean":"2024-09-12T02:34:53.922936+0000","last_became_active":"2024-09-12T02:34:53.919134+0000","last_became_peered":"2024-09-12T02:34:53.919134+0000","last_unstale":"2024-09-12T02:34:53.922936+0000","last_undegraded":"2024-09-12T02:34:53.922936+0000","last_fullsized":"2024-09-12T02:34:53.922936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:00.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923263+0000","last_change":"2024-09-12T02:34:53.919705+0000","last_active":"2024-09-12T02:34:53.923263+0000","last_peered":"2024-09-12T02:34:53.923263+0000","last_clean":"2024-09-12T02:34:53.923263+0000","last_became_active":"2024-09-12T02:34:53.919433+0000","last_became_peered":"2024-09-12T02:34:53.919433+0000","last_unstale":"2024-09-12T02:34:53.923263+0000","last_undegraded":"2024-09-12T02:34:53.923263+0000","last_fullsized":"2024-09-12T02:34:53.923263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:10.620223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921150+0000","last_change":"2024-09-12T02:34:53.914329+0000","last_active":"2024-09-12T02:34:53.921150+0000","last_peered":"2024-09-12T02:34:53.921150+0000","last_clean":"2024-09-12T02:34:53.921150+0000","last_became_active":"2024-09-12T02:34:53.914049+0000","last_became_peered":"2024-09-12T02:34:53.914049+0000","last_unstale":"2024-09-12T02:34:53.921150+0000","last_undegraded":"2024-09-12T02:34:53.921150+0000","last_fullsized":"2024-09-12T02:34:53.921150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.975603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922663+0000","last_change":"2024-09-12T02:34:53.918077+0000","last_active":"2024-09-12T02:34:53.922663+0000","last_peered":"2024-09-12T02:34:53.922663+0000","last_clean":"2024-09-12T02:34:53.922663+0000","last_became_active":"2024-09-12T02:34:53.917730+0000","last_became_peered":"2024-09-12T02:34:53.917730+0000","last_unstale":"2024-09-12T02:34:53.922663+0000","last_undegraded":"2024-09-12T02:34:53.922663+0000","last_fullsized":"2024-09-12T02:34:53.922663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936684+0000","last_change":"2024-09-12T02:34:52.905869+0000","last_active":"2024-09-12T02:34:53.936684+0000","last_peered":"2024-09-12T02:34:53.936684+0000","last_clean":"2024-09-12T02:34:53.936684+0000","last_became_active":"2024-09-12T02:34:52.905438+0000","last_became_peered":"2024-09-12T02:34:52.905438+0000","last_unstale":"2024-09-12T02:34:53.936684+0000","last_undegraded":"2024-09-12T02:34:53.936684+0000","last_fullsized":"2024-09-12T02:34:53.936684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:37.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928019+0000","last_change":"2024-09-12T02:34:53.925843+0000","last_active":"2024-09-12T02:34:53.928019+0000","last_peered":"2024-09-12T02:34:53.928019+0000","last_clean":"2024-09-12T02:34:53.928019+0000","last_became_active":"2024-09-12T02:34:53.925579+0000","last_became_peered":"2024-09-12T02:34:53.925579+0000","last_unstale":"2024-09-12T02:34:53.928019+0000","last_undegraded":"2024-09-12T02:34:53.928019+0000","last_fullsized":"2024-09-12T02:34:53.928019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926540+0000","last_change":"2024-09-12T02:34:52.897888+0000","last_active":"2024-09-12T02:34:53.926540+0000","last_peered":"2024-09-12T02:34:53.926540+0000","last_clean":"2024-09-12T02:34:53.926540+0000","last_became_active":"2024-09-12T02:34:52.897621+0000","last_became_peered":"2024-09-12T02:34:52.897621+0000","last_unstale":"2024-09-12T02:34:53.926540+0000","last_undegraded":"2024-09-12T02:34:53.926540+0000","last_fullsized":"2024-09-12T02:34:53.926540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.931447+0000","last_change":"2024-09-12T02:34:52.907910+0000","last_active":"2024-09-12T02:34:53.931447+0000","last_peered":"2024-09-12T02:34:53.931447+0000","last_clean":"2024-09-12T02:34:53.931447+0000","last_became_active":"2024-09-12T02:34:52.907702+0000","last_became_peered":"2024-09-12T02:34:52.907702+0000","last_unstale":"2024-09-12T02:34:53.931447+0000","last_undegraded":"2024-09-12T02:34:53.931447+0000","last_fullsized":"2024-09-12T02:34:53.931447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894660+0000","last_change":"2024-09-12T02:34:52.894660+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894660+0000","last_undegraded":"2024-09-12T02:34:52.894660+0000","last_fullsized":"2024-09-12T02:34:52.894660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.925209+0000","last_change":"2024-09-12T02:34:53.919992+0000","last_active":"2024-09-12T02:34:53.925209+0000","last_peered":"2024-09-12T02:34:53.925209+0000","last_clean":"2024-09-12T02:34:53.925209+0000","last_became_active":"2024-09-12T02:34:53.919720+0000","last_became_peered":"2024-09-12T02:34:53.919720+0000","last_unstale":"2024-09-12T02:34:53.925209+0000","last_undegraded":"2024-09-12T02:34:53.925209+0000","last_fullsized":"2024-09-12T02:34:53.925209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.910539+0000","last_change":"2024-09-12T02:34:52.904914+0000","last_active":"2024-09-12T02:34:53.910539+0000","last_peered":"2024-09-12T02:34:53.910539+0000","last_clean":"2024-09-12T02:34:53.910539+0000","last_became_active":"2024-09-12T02:34:52.904645+0000","last_became_peered":"2024-09-12T02:34:52.904645+0000","last_unstale":"2024-09-12T02:34:53.910539+0000","last_undegraded":"2024-09-12T02:34:53.910539+0000","last_fullsized":"2024-09-12T02:34:53.910539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895781+0000","last_change":"2024-09-12T02:34:52.895781+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895781+0000","last_undegraded":"2024-09-12T02:34:52.895781+0000","last_fullsized":"2024-09-12T02:34:52.895781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901806+0000","last_change":"2024-09-12T02:34:52.899622+0000","last_active":"2024-09-12T02:34:52.901806+0000","last_peered":"2024-09-12T02:34:52.901806+0000","last_clean":"2024-09-12T02:34:52.901806+0000","last_became_active":"2024-09-12T02:34:52.899362+0000","last_became_peered":"2024-09-12T02:34:52.899362+0000","last_unstale":"2024-09-12T02:34:52.901806+0000","last_undegraded":"2024-09-12T02:34:52.901806+0000","last_fullsized":"2024-09-12T02:34:52.901806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.833616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922418+0000","last_change":"2024-09-12T02:34:53.917563+0000","last_active":"2024-09-12T02:34:53.922418+0000","last_peered":"2024-09-12T02:34:53.922418+0000","last_clean":"2024-09-12T02:34:53.922418+0000","last_became_active":"2024-09-12T02:34:53.917297+0000","last_became_peered":"2024-09-12T02:34:53.917297+0000","last_unstale":"2024-09-12T02:34:53.922418+0000","last_undegraded":"2024-09-12T02:34:53.922418+0000","last_fullsized":"2024-09-12T02:34:53.922418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901833+0000","last_change":"2024-09-12T02:34:52.899558+0000","last_active":"2024-09-12T02:34:52.901833+0000","last_peered":"2024-09-12T02:34:52.901833+0000","last_clean":"2024-09-12T02:34:52.901833+0000","last_became_active":"2024-09-12T02:34:52.899304+0000","last_became_peered":"2024-09-12T02:34:52.899304+0000","last_unstale":"2024-09-12T02:34:52.901833+0000","last_undegraded":"2024-09-12T02:34:52.901833+0000","last_fullsized":"2024-09-12T02:34:52.901833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:53.361266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926578+0000","last_change":"2024-09-12T02:34:53.922769+0000","last_active":"2024-09-12T02:34:53.926578+0000","last_peered":"2024-09-12T02:34:53.926578+0000","last_clean":"2024-09-12T02:34:53.926578+0000","last_became_active":"2024-09-12T02:34:53.922500+0000","last_became_peered":"2024-09-12T02:34:53.922500+0000","last_unstale":"2024-09-12T02:34:53.926578+0000","last_undegraded":"2024-09-12T02:34:53.926578+0000","last_fullsized":"2024-09-12T02:34:53.926578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.905029+0000","last_change":"2024-09-12T02:34:52.902405+0000","last_active":"2024-09-12T02:34:52.905029+0000","last_peered":"2024-09-12T02:34:52.905029+0000","last_clean":"2024-09-12T02:34:52.905029+0000","last_became_active":"2024-09-12T02:34:52.902161+0000","last_became_peered":"2024-09-12T02:34:52.902161+0000","last_unstale":"2024-09-12T02:34:52.905029+0000","last_undegraded":"2024-09-12T02:34:52.905029+0000","last_fullsized":"2024-09-12T02:34:52.905029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.412066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892700+0000","last_change":"2024-09-12T02:34:52.892700+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892700+0000","last_undegraded":"2024-09-12T02:34:52.892700+0000","last_fullsized":"2024-09-12T02:34:52.892700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.913762+0000","last_change":"2024-09-12T02:34:52.907610+0000","last_active":"2024-09-12T02:34:53.913762+0000","last_peered":"2024-09-12T02:34:53.913762+0000","last_clean":"2024-09-12T02:34:53.913762+0000","last_became_active":"2024-09-12T02:34:52.907304+0000","last_became_peered":"2024-09-12T02:34:52.907304+0000","last_unstale":"2024-09-12T02:34:53.913762+0000","last_undegraded":"2024-09-12T02:34:53.913762+0000","last_fullsized":"2024-09-12T02:34:53.913762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.902502+0000","last_change":"2024-09-12T02:34:52.905674+0000","last_active":"2024-09-12T02:34:53.902502+0000","last_peered":"2024-09-12T02:34:53.902502+0000","last_clean":"2024-09-12T02:34:53.902502+0000","last_became_active":"2024-09-12T02:34:52.905397+0000","last_became_peered":"2024-09-12T02:34:52.905397+0000","last_unstale":"2024-09-12T02:34:53.902502+0000","last_undegraded":"2024-09-12T02:34:53.902502+0000","last_fullsized":"2024-09-12T02:34:53.902502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895448+0000","last_change":"2024-09-12T02:34:52.895448+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895448+0000","last_undegraded":"2024-09-12T02:34:52.895448+0000","last_fullsized":"2024-09-12T02:34:52.895448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892914+0000","last_change":"2024-09-12T02:34:52.892914+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892914+0000","last_undegraded":"2024-09-12T02:34:52.892914+0000","last_fullsized":"2024-09-12T02:34:52.892914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888257+0000","last_change":"2024-09-12T02:34:51.888257+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888257+0000","last_undegraded":"2024-09-12T02:34:51.888257+0000","last_fullsized":"2024-09-12T02:34:51.888257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.911000+0000","last_change":"2024-09-12T02:34:52.907743+0000","last_active":"2024-09-12T02:34:53.911000+0000","last_peered":"2024-09-12T02:34:53.911000+0000","last_clean":"2024-09-12T02:34:53.911000+0000","last_became_active":"2024-09-12T02:34:52.907497+0000","last_became_peered":"2024-09-12T02:34:52.907497+0000","last_unstale":"2024-09-12T02:34:53.911000+0000","last_undegraded":"2024-09-12T02:34:53.911000+0000","last_fullsized":"2024-09-12T02:34:53.911000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888252+0000","last_change":"2024-09-12T02:34:51.888252+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888252+0000","last_undegraded":"2024-09-12T02:34:51.888252+0000","last_fullsized":"2024-09-12T02:34:51.888252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922382+0000","last_change":"2024-09-12T02:34:53.917794+0000","last_active":"2024-09-12T02:34:53.922382+0000","last_peered":"2024-09-12T02:34:53.922382+0000","last_clean":"2024-09-12T02:34:53.922382+0000","last_became_active":"2024-09-12T02:34:53.917420+0000","last_became_peered":"2024-09-12T02:34:53.917420+0000","last_unstale":"2024-09-12T02:34:53.922382+0000","last_undegraded":"2024-09-12T02:34:53.922382+0000","last_fullsized":"2024-09-12T02:34:53.922382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888239+0000","last_change":"2024-09-12T02:34:51.888239+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888239+0000","last_undegraded":"2024-09-12T02:34:51.888239+0000","last_fullsized":"2024-09-12T02:34:51.888239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895096+0000","last_change":"2024-09-12T02:34:52.895096+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895096+0000","last_undegraded":"2024-09-12T02:34:52.895096+0000","last_fullsized":"2024-09-12T02:34:52.895096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888007+0000","last_change":"2024-09-12T02:34:51.888007+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888007+0000","last_undegraded":"2024-09-12T02:34:51.888007+0000","last_fullsized":"2024-09-12T02:34:51.888007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933097+0000","last_change":"2024-09-12T02:34:53.930914+0000","last_active":"2024-09-12T02:34:53.933097+0000","last_peered":"2024-09-12T02:34:53.933097+0000","last_clean":"2024-09-12T02:34:53.933097+0000","last_became_active":"2024-09-12T02:34:53.930647+0000","last_became_peered":"2024-09-12T02:34:53.930647+0000","last_unstale":"2024-09-12T02:34:53.933097+0000","last_undegraded":"2024-09-12T02:34:53.933097+0000","last_fullsized":"2024-09-12T02:34:53.933097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.887613+0000","last_change":"2024-09-12T02:34:51.887613+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.887613+0000","last_undegraded":"2024-09-12T02:34:51.887613+0000","last_fullsized":"2024-09-12T02:34:51.887613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.891836+0000","last_change":"2024-09-12T02:34:52.891836+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.891836+0000","last_undegraded":"2024-09-12T02:34:52.891836+0000","last_fullsized":"2024-09-12T02:34:52.891836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.907540+0000","last_change":"2024-09-12T02:34:52.898024+0000","last_active":"2024-09-12T02:34:53.907540+0000","last_peered":"2024-09-12T02:34:53.907540+0000","last_clean":"2024-09-12T02:34:53.907540+0000","last_became_active":"2024-09-12T02:34:52.897771+0000","last_became_peered":"2024-09-12T02:34:52.897771+0000","last_unstale":"2024-09-12T02:34:53.907540+0000","last_undegraded":"2024-09-12T02:34:53.907540+0000","last_fullsized":"2024-09-12T02:34:53.907540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.919349+0000","last_change":"2024-09-12T02:34:53.916828+0000","last_active":"2024-09-12T02:34:53.919349+0000","last_peered":"2024-09-12T02:34:53.919349+0000","last_clean":"2024-09-12T02:34:53.919349+0000","last_became_active":"2024-09-12T02:34:53.916543+0000","last_became_peered":"2024-09-12T02:34:53.916543+0000","last_unstale":"2024-09-12T02:34:53.919349+0000","last_undegraded":"2024-09-12T02:34:53.919349+0000","last_fullsized":"2024-09-12T02:34:53.919349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908630+0000","last_change":"2024-09-12T02:34:52.896981+0000","last_active":"2024-09-12T02:34:53.908630+0000","last_peered":"2024-09-12T02:34:53.908630+0000","last_clean":"2024-09-12T02:34:53.908630+0000","last_became_active":"2024-09-12T02:34:52.896728+0000","last_became_peered":"2024-09-12T02:34:52.896728+0000","last_unstale":"2024-09-12T02:34:53.908630+0000","last_undegraded":"2024-09-12T02:34:53.908630+0000","last_fullsized":"2024-09-12T02:34:53.908630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:51.190888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922569+0000","last_change":"2024-09-12T02:34:53.917338+0000","last_active":"2024-09-12T02:34:53.922569+0000","last_peered":"2024-09-12T02:34:53.922569+0000","last_clean":"2024-09-12T02:34:53.922569+0000","last_became_active":"2024-09-12T02:34:53.917083+0000","last_became_peered":"2024-09-12T02:34:53.917083+0000","last_unstale":"2024-09-12T02:34:53.922569+0000","last_undegraded":"2024-09-12T02:34:53.922569+0000","last_fullsized":"2024-09-12T02:34:53.922569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.903380+0000","last_change":"2024-09-12T02:34:52.899652+0000","last_active":"2024-09-12T02:34:53.903380+0000","last_peered":"2024-09-12T02:34:53.903380+0000","last_clean":"2024-09-12T02:34:53.903380+0000","last_became_active":"2024-09-12T02:34:52.899400+0000","last_became_peered":"2024-09-12T02:34:52.899400+0000","last_unstale":"2024-09-12T02:34:53.903380+0000","last_undegraded":"2024-09-12T02:34:53.903380+0000","last_fullsized":"2024-09-12T02:34:53.903380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.376482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.902019+0000","last_change":"2024-09-12T02:34:52.899954+0000","last_active":"2024-09-12T02:34:52.902019+0000","last_peered":"2024-09-12T02:34:52.902019+0000","last_clean":"2024-09-12T02:34:52.902019+0000","last_became_active":"2024-09-12T02:34:52.899233+0000","last_became_peered":"2024-09-12T02:34:52.899233+0000","last_unstale":"2024-09-12T02:34:52.902019+0000","last_undegraded":"2024-09-12T02:34:52.902019+0000","last_fullsized":"2024-09-12T02:34:52.902019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:03.154855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:34:48.399670+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:48.399670+0000","last_peered":"2024-09-12T02:34:48.399670+0000","last_clean":"2024-09-12T02:34:48.399670+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:48.399670+0000","last_undegraded":"2024-09-12T02:34:48.399670+0000","last_fullsized":"2024-09-12T02:34:48.399670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":401408,"data_stored":169442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":425984,"data_stored":182318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":772686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:56.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.981+0000 7f41e2a82640 1 Processor -- start 2024-09-12T02:34:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.981+0000 7f41e2a82640 1 -- start start 2024-09-12T02:34:56.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e2a82640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41dc0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e2a82640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41dc0cd650 0x7f41dc0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e2a82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc0b68e0 con 0x7f41dc0afd70 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e2a82640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc06fdb0 con 0x7f41dc0cd650 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e2a82640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc070090 con 0x7f41dc0b5f80 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e081e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f41dc0afd70 0x7f41dc160820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48294/0 (socket says 172.21.15.119:48294) 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e081e640 1 -- 172.21.15.119:0/2102665255 learned_addr learned my addr 172.21.15.119:0/2102665255 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41e101f640 1 --2- 172.21.15.119:0/2102665255 >> v2:172.21.15.153:3300/0 conn(0x7f41dc0cd650 0x7f41dc0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41dbfff640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41dc0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.982+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837247556 0 0) 0x7f41dc0b68e0 con 0x7f41dc0afd70 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c4003520 con 0x7f41dc0afd70 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4287817038 0 0) 0x7f41c4003520 con 0x7f41dc0afd70 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 msgr2=0x7f41dc0b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41dc0b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 >> v2:172.21.15.153:3300/0 conn(0x7f41dc0cd650 msgr2=0x7f41dc0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 --2- 172.21.15.119:0/2102665255 >> v2:172.21.15.153:3300/0 conn(0x7f41dc0cd650 0x7f41dc0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc070370 con 0x7f41dc0afd70 2024-09-12T02:34:56.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f41cc001670 con 0x7f41dc0afd70 2024-09-12T02:34:56.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e101f640 1 --2- 172.21.15.119:0/2102665255 >> v2:172.21.15.153:3300/0 conn(0x7f41dc0cd650 0x7f41dc0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:56.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41dbfff640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41dc0b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 >> v1:172.21.15.119:6789/0 conn(0x7f41dc0afd70 legacy=0x7f41dc160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c40039b0 0x7f41c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c4004d40 0x7f41c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc06fdb0 con 0x7f41c40039b0 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc070090 con 0x7f41c4004d40 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41c400b9c0 con 0x7f41dc0b5f80 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c40039b0 0x7f41c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e101f640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c4004d40 0x7f41c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41dbfff640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 -- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 msgr2=0x7f41c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 -- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c4004d40 msgr2=0x7f41c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c4004d40 0x7f41c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41e081e640 1 -- 172.21.15.119:0/2102665255 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4003520 con 0x7f41c40039b0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.983+0000 7f41dbfff640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0b5f80 0x7f41c4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.984+0000 7f41e081e640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c40039b0 0x7f41c4003dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c290 tx=0x7f41c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8300633b132357 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.984+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc007d50 con 0x7f41c40039b0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.984+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc005af0 con 0x7f41c40039b0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.984+0000 7f41db7fe640 1 -- 172.21.15.119:0/2102665255 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc007070 con 0x7f41c40039b0 2024-09-12T02:34:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 -- 172.21.15.119:0/2102665255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c40039b0 msgr2=0x7f41c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 --2- 172.21.15.119:0/2102665255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41c40039b0 0x7f41c4003dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c290 tx=0x7f41c4005830 comp rx=0 tx=0).stop 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e101f640 1 -- 172.21.15.119:0/2102665255 reap_dead start 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 -- 172.21.15.119:0/2102665255 shutdown_connections 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 -- 172.21.15.119:0/2102665255 >> 172.21.15.119:0/2102665255 conn(0x7f41dc06bc10 msgr2=0x7f41dc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 -- 172.21.15.119:0/2102665255 shutdown_connections 2024-09-12T02:34:56.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.985+0000 7f41e2a82640 1 -- 172.21.15.119:0/2102665255 wait complete. 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.986+0000 7f41e2a82640 1 Processor -- start 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.986+0000 7f41e2a82640 1 -- start start 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c40039b0 0x7f41dc150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 0x7f41dc0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0b0150 con 0x7f41dc15e850 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc06fa80 con 0x7f41c40039b0 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc160060 con 0x7f41dc0aebe0 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46956/0 (socket says 172.21.15.119:46956) 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 -- 172.21.15.119:0/4163852183 learned_addr learned my addr 172.21.15.119:0/4163852183 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e081e640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c40039b0 0x7f41dc150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e101f640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 0x7f41dc0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 -- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 msgr2=0x7f41dc0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 0x7f41dc0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 -- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c40039b0 msgr2=0x7f41dc150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c40039b0 0x7f41dc150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 -- 172.21.15.119:0/4163852183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc158e50 con 0x7f41dc15e850 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e101f640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 0x7f41dc0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41dbfff640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007f00 tx=0x7f41d00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d001a030 con 0x7f41dc15e850 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0003990 con 0x7f41dc15e850 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0003b60 con 0x7f41dc15e850 2024-09-12T02:34:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.987+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc159130 con 0x7f41dc15e850 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.988+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc1596f0 con 0x7f41dc15e850 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.989+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc0b63a0 con 0x7f41dc15e850 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.989+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41d0005d10 con 0x7f41dc15e850 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.989+0000 7f41d97fa640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 0x7f41c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.990+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f41d008b9f0 con 0x7f41dc15e850 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.990+0000 7f41e081e640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 0x7f41c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.990+0000 7f41e081e640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 0x7f41c806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41cc033000 tx=0x7f41cc009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:56.994+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41d0024070 con 0x7f41dc15e850 2024-09-12T02:34:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.156+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41dc15f210 con 0x7f41c806be30 2024-09-12T02:34:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.162+0000 7f41d97fa640 1 -- 172.21.15.119:0/4163852183 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243655 (secure 0 0 0) 0x7f41dc15f210 con 0x7f41c806be30 2024-09-12T02:34:57.166 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 msgr2=0x7f41c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 0x7f41c806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41cc033000 tx=0x7f41cc009030 comp rx=0 tx=0).stop 2024-09-12T02:34:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 msgr2=0x7f41dc15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007f00 tx=0x7f41d00115a0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 shutdown_connections 2024-09-12T02:34:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f41c806be30 0x7f41c806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41dc0aebe0 0x7f41dc0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41dc15e850 0x7f41dc15ecd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 --2- 172.21.15.119:0/4163852183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c40039b0 0x7f41dc150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 >> 172.21.15.119:0/4163852183 conn(0x7f41dc06bc10 msgr2=0x7f41dc156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 shutdown_connections 2024-09-12T02:34:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.165+0000 7f41e2a82640 1 -- 172.21.15.119:0/4163852183 wait complete. 2024-09-12T02:34:57.176 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T02:34:55.190714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":220652,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754068,"statfs":{"total":773094113280,"available":772868165632,"internally_reserved":0,"allocated":4513792,"data_stored":2595067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000562"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894314+0000","last_change":"2024-09-12T02:34:52.894314+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894314+0000","last_undegraded":"2024-09-12T02:34:52.894314+0000","last_fullsized":"2024-09-12T02:34:52.894314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892289+0000","last_change":"2024-09-12T02:34:52.892289+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892289+0000","last_undegraded":"2024-09-12T02:34:52.892289+0000","last_fullsized":"2024-09-12T02:34:52.892289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.927110+0000","last_change":"2024-09-12T02:34:53.925071+0000","last_active":"2024-09-12T02:34:53.927110+0000","last_peered":"2024-09-12T02:34:53.927110+0000","last_clean":"2024-09-12T02:34:53.927110+0000","last_became_active":"2024-09-12T02:34:53.924546+0000","last_became_peered":"2024-09-12T02:34:53.924546+0000","last_unstale":"2024-09-12T02:34:53.927110+0000","last_undegraded":"2024-09-12T02:34:53.927110+0000","last_fullsized":"2024-09-12T02:34:53.927110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928050+0000","last_change":"2024-09-12T02:34:53.926491+0000","last_active":"2024-09-12T02:34:53.928050+0000","last_peered":"2024-09-12T02:34:53.928050+0000","last_clean":"2024-09-12T02:34:53.928050+0000","last_became_active":"2024-09-12T02:34:53.926211+0000","last_became_peered":"2024-09-12T02:34:53.926211+0000","last_unstale":"2024-09-12T02:34:53.928050+0000","last_undegraded":"2024-09-12T02:34:53.928050+0000","last_fullsized":"2024-09-12T02:34:53.928050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.893487+0000","last_change":"2024-09-12T02:34:52.893487+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.893487+0000","last_undegraded":"2024-09-12T02:34:52.893487+0000","last_fullsized":"2024-09-12T02:34:52.893487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926607+0000","last_change":"2024-09-12T02:34:53.922929+0000","last_active":"2024-09-12T02:34:53.926607+0000","last_peered":"2024-09-12T02:34:53.926607+0000","last_clean":"2024-09-12T02:34:53.926607+0000","last_became_active":"2024-09-12T02:34:53.922520+0000","last_became_peered":"2024-09-12T02:34:53.922520+0000","last_unstale":"2024-09-12T02:34:53.926607+0000","last_undegraded":"2024-09-12T02:34:53.926607+0000","last_fullsized":"2024-09-12T02:34:53.926607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922349+0000","last_change":"2024-09-12T02:34:53.916964+0000","last_active":"2024-09-12T02:34:53.922349+0000","last_peered":"2024-09-12T02:34:53.922349+0000","last_clean":"2024-09-12T02:34:53.922349+0000","last_became_active":"2024-09-12T02:34:53.916680+0000","last_became_peered":"2024-09-12T02:34:53.916680+0000","last_unstale":"2024-09-12T02:34:53.922349+0000","last_undegraded":"2024-09-12T02:34:53.922349+0000","last_fullsized":"2024-09-12T02:34:53.922349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914563+0000","last_change":"2024-09-12T02:34:53.907701+0000","last_active":"2024-09-12T02:34:53.914563+0000","last_peered":"2024-09-12T02:34:53.914563+0000","last_clean":"2024-09-12T02:34:53.914563+0000","last_became_active":"2024-09-12T02:34:53.907425+0000","last_became_peered":"2024-09-12T02:34:53.907425+0000","last_unstale":"2024-09-12T02:34:53.914563+0000","last_undegraded":"2024-09-12T02:34:53.914563+0000","last_fullsized":"2024-09-12T02:34:53.914563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:21.915931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914760+0000","last_change":"2024-09-12T02:34:53.908746+0000","last_active":"2024-09-12T02:34:53.914760+0000","last_peered":"2024-09-12T02:34:53.914760+0000","last_clean":"2024-09-12T02:34:53.914760+0000","last_became_active":"2024-09-12T02:34:53.908484+0000","last_became_peered":"2024-09-12T02:34:53.908484+0000","last_unstale":"2024-09-12T02:34:53.914760+0000","last_undegraded":"2024-09-12T02:34:53.914760+0000","last_fullsized":"2024-09-12T02:34:53.914760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:03.587388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923956+0000","last_change":"2024-09-12T02:34:53.920936+0000","last_active":"2024-09-12T02:34:53.923956+0000","last_peered":"2024-09-12T02:34:53.923956+0000","last_clean":"2024-09-12T02:34:53.923956+0000","last_became_active":"2024-09-12T02:34:53.920663+0000","last_became_peered":"2024-09-12T02:34:53.920663+0000","last_unstale":"2024-09-12T02:34:53.923956+0000","last_undegraded":"2024-09-12T02:34:53.923956+0000","last_fullsized":"2024-09-12T02:34:53.923956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:39.371309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933174+0000","last_change":"2024-09-12T02:34:53.931129+0000","last_active":"2024-09-12T02:34:53.933174+0000","last_peered":"2024-09-12T02:34:53.933174+0000","last_clean":"2024-09-12T02:34:53.933174+0000","last_became_active":"2024-09-12T02:34:53.930795+0000","last_became_peered":"2024-09-12T02:34:53.930795+0000","last_unstale":"2024-09-12T02:34:53.933174+0000","last_undegraded":"2024-09-12T02:34:53.933174+0000","last_fullsized":"2024-09-12T02:34:53.933174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922936+0000","last_change":"2024-09-12T02:34:53.919417+0000","last_active":"2024-09-12T02:34:53.922936+0000","last_peered":"2024-09-12T02:34:53.922936+0000","last_clean":"2024-09-12T02:34:53.922936+0000","last_became_active":"2024-09-12T02:34:53.919134+0000","last_became_peered":"2024-09-12T02:34:53.919134+0000","last_unstale":"2024-09-12T02:34:53.922936+0000","last_undegraded":"2024-09-12T02:34:53.922936+0000","last_fullsized":"2024-09-12T02:34:53.922936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:00.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923263+0000","last_change":"2024-09-12T02:34:53.919705+0000","last_active":"2024-09-12T02:34:53.923263+0000","last_peered":"2024-09-12T02:34:53.923263+0000","last_clean":"2024-09-12T02:34:53.923263+0000","last_became_active":"2024-09-12T02:34:53.919433+0000","last_became_peered":"2024-09-12T02:34:53.919433+0000","last_unstale":"2024-09-12T02:34:53.923263+0000","last_undegraded":"2024-09-12T02:34:53.923263+0000","last_fullsized":"2024-09-12T02:34:53.923263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:10.620223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921150+0000","last_change":"2024-09-12T02:34:53.914329+0000","last_active":"2024-09-12T02:34:53.921150+0000","last_peered":"2024-09-12T02:34:53.921150+0000","last_clean":"2024-09-12T02:34:53.921150+0000","last_became_active":"2024-09-12T02:34:53.914049+0000","last_became_peered":"2024-09-12T02:34:53.914049+0000","last_unstale":"2024-09-12T02:34:53.921150+0000","last_undegraded":"2024-09-12T02:34:53.921150+0000","last_fullsized":"2024-09-12T02:34:53.921150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.975603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922663+0000","last_change":"2024-09-12T02:34:53.918077+0000","last_active":"2024-09-12T02:34:53.922663+0000","last_peered":"2024-09-12T02:34:53.922663+0000","last_clean":"2024-09-12T02:34:53.922663+0000","last_became_active":"2024-09-12T02:34:53.917730+0000","last_became_peered":"2024-09-12T02:34:53.917730+0000","last_unstale":"2024-09-12T02:34:53.922663+0000","last_undegraded":"2024-09-12T02:34:53.922663+0000","last_fullsized":"2024-09-12T02:34:53.922663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936684+0000","last_change":"2024-09-12T02:34:52.905869+0000","last_active":"2024-09-12T02:34:53.936684+0000","last_peered":"2024-09-12T02:34:53.936684+0000","last_clean":"2024-09-12T02:34:53.936684+0000","last_became_active":"2024-09-12T02:34:52.905438+0000","last_became_peered":"2024-09-12T02:34:52.905438+0000","last_unstale":"2024-09-12T02:34:53.936684+0000","last_undegraded":"2024-09-12T02:34:53.936684+0000","last_fullsized":"2024-09-12T02:34:53.936684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:37.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928019+0000","last_change":"2024-09-12T02:34:53.925843+0000","last_active":"2024-09-12T02:34:53.928019+0000","last_peered":"2024-09-12T02:34:53.928019+0000","last_clean":"2024-09-12T02:34:53.928019+0000","last_became_active":"2024-09-12T02:34:53.925579+0000","last_became_peered":"2024-09-12T02:34:53.925579+0000","last_unstale":"2024-09-12T02:34:53.928019+0000","last_undegraded":"2024-09-12T02:34:53.928019+0000","last_fullsized":"2024-09-12T02:34:53.928019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926540+0000","last_change":"2024-09-12T02:34:52.897888+0000","last_active":"2024-09-12T02:34:53.926540+0000","last_peered":"2024-09-12T02:34:53.926540+0000","last_clean":"2024-09-12T02:34:53.926540+0000","last_became_active":"2024-09-12T02:34:52.897621+0000","last_became_peered":"2024-09-12T02:34:52.897621+0000","last_unstale":"2024-09-12T02:34:53.926540+0000","last_undegraded":"2024-09-12T02:34:53.926540+0000","last_fullsized":"2024-09-12T02:34:53.926540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.931447+0000","last_change":"2024-09-12T02:34:52.907910+0000","last_active":"2024-09-12T02:34:53.931447+0000","last_peered":"2024-09-12T02:34:53.931447+0000","last_clean":"2024-09-12T02:34:53.931447+0000","last_became_active":"2024-09-12T02:34:52.907702+0000","last_became_peered":"2024-09-12T02:34:52.907702+0000","last_unstale":"2024-09-12T02:34:53.931447+0000","last_undegraded":"2024-09-12T02:34:53.931447+0000","last_fullsized":"2024-09-12T02:34:53.931447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894660+0000","last_change":"2024-09-12T02:34:52.894660+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894660+0000","last_undegraded":"2024-09-12T02:34:52.894660+0000","last_fullsized":"2024-09-12T02:34:52.894660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.925209+0000","last_change":"2024-09-12T02:34:53.919992+0000","last_active":"2024-09-12T02:34:53.925209+0000","last_peered":"2024-09-12T02:34:53.925209+0000","last_clean":"2024-09-12T02:34:53.925209+0000","last_became_active":"2024-09-12T02:34:53.919720+0000","last_became_peered":"2024-09-12T02:34:53.919720+0000","last_unstale":"2024-09-12T02:34:53.925209+0000","last_undegraded":"2024-09-12T02:34:53.925209+0000","last_fullsized":"2024-09-12T02:34:53.925209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.910539+0000","last_change":"2024-09-12T02:34:52.904914+0000","last_active":"2024-09-12T02:34:53.910539+0000","last_peered":"2024-09-12T02:34:53.910539+0000","last_clean":"2024-09-12T02:34:53.910539+0000","last_became_active":"2024-09-12T02:34:52.904645+0000","last_became_peered":"2024-09-12T02:34:52.904645+0000","last_unstale":"2024-09-12T02:34:53.910539+0000","last_undegraded":"2024-09-12T02:34:53.910539+0000","last_fullsized":"2024-09-12T02:34:53.910539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895781+0000","last_change":"2024-09-12T02:34:52.895781+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895781+0000","last_undegraded":"2024-09-12T02:34:52.895781+0000","last_fullsized":"2024-09-12T02:34:52.895781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901806+0000","last_change":"2024-09-12T02:34:52.899622+0000","last_active":"2024-09-12T02:34:52.901806+0000","last_peered":"2024-09-12T02:34:52.901806+0000","last_clean":"2024-09-12T02:34:52.901806+0000","last_became_active":"2024-09-12T02:34:52.899362+0000","last_became_peered":"2024-09-12T02:34:52.899362+0000","last_unstale":"2024-09-12T02:34:52.901806+0000","last_undegraded":"2024-09-12T02:34:52.901806+0000","last_fullsized":"2024-09-12T02:34:52.901806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.833616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922418+0000","last_change":"2024-09-12T02:34:53.917563+0000","last_active":"2024-09-12T02:34:53.922418+0000","last_peered":"2024-09-12T02:34:53.922418+0000","last_clean":"2024-09-12T02:34:53.922418+0000","last_became_active":"2024-09-12T02:34:53.917297+0000","last_became_peered":"2024-09-12T02:34:53.917297+0000","last_unstale":"2024-09-12T02:34:53.922418+0000","last_undegraded":"2024-09-12T02:34:53.922418+0000","last_fullsized":"2024-09-12T02:34:53.922418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901833+0000","last_change":"2024-09-12T02:34:52.899558+0000","last_active":"2024-09-12T02:34:52.901833+0000","last_peered":"2024-09-12T02:34:52.901833+0000","last_clean":"2024-09-12T02:34:52.901833+0000","last_became_active":"2024-09-12T02:34:52.899304+0000","last_became_peered":"2024-09-12T02:34:52.899304+0000","last_unstale":"2024-09-12T02:34:52.901833+0000","last_undegraded":"2024-09-12T02:34:52.901833+0000","last_fullsized":"2024-09-12T02:34:52.901833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:53.361266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926578+0000","last_change":"2024-09-12T02:34:53.922769+0000","last_active":"2024-09-12T02:34:53.926578+0000","last_peered":"2024-09-12T02:34:53.926578+0000","last_clean":"2024-09-12T02:34:53.926578+0000","last_became_active":"2024-09-12T02:34:53.922500+0000","last_became_peered":"2024-09-12T02:34:53.922500+0000","last_unstale":"2024-09-12T02:34:53.926578+0000","last_undegraded":"2024-09-12T02:34:53.926578+0000","last_fullsized":"2024-09-12T02:34:53.926578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.905029+0000","last_change":"2024-09-12T02:34:52.902405+0000","last_active":"2024-09-12T02:34:52.905029+0000","last_peered":"2024-09-12T02:34:52.905029+0000","last_clean":"2024-09-12T02:34:52.905029+0000","last_became_active":"2024-09-12T02:34:52.902161+0000","last_became_peered":"2024-09-12T02:34:52.902161+0000","last_unstale":"2024-09-12T02:34:52.905029+0000","last_undegraded":"2024-09-12T02:34:52.905029+0000","last_fullsized":"2024-09-12T02:34:52.905029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.412066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892700+0000","last_change":"2024-09-12T02:34:52.892700+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892700+0000","last_undegraded":"2024-09-12T02:34:52.892700+0000","last_fullsized":"2024-09-12T02:34:52.892700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.913762+0000","last_change":"2024-09-12T02:34:52.907610+0000","last_active":"2024-09-12T02:34:53.913762+0000","last_peered":"2024-09-12T02:34:53.913762+0000","last_clean":"2024-09-12T02:34:53.913762+0000","last_became_active":"2024-09-12T02:34:52.907304+0000","last_became_peered":"2024-09-12T02:34:52.907304+0000","last_unstale":"2024-09-12T02:34:53.913762+0000","last_undegraded":"2024-09-12T02:34:53.913762+0000","last_fullsized":"2024-09-12T02:34:53.913762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.902502+0000","last_change":"2024-09-12T02:34:52.905674+0000","last_active":"2024-09-12T02:34:53.902502+0000","last_peered":"2024-09-12T02:34:53.902502+0000","last_clean":"2024-09-12T02:34:53.902502+0000","last_became_active":"2024-09-12T02:34:52.905397+0000","last_became_peered":"2024-09-12T02:34:52.905397+0000","last_unstale":"2024-09-12T02:34:53.902502+0000","last_undegraded":"2024-09-12T02:34:53.902502+0000","last_fullsized":"2024-09-12T02:34:53.902502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895448+0000","last_change":"2024-09-12T02:34:52.895448+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895448+0000","last_undegraded":"2024-09-12T02:34:52.895448+0000","last_fullsized":"2024-09-12T02:34:52.895448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892914+0000","last_change":"2024-09-12T02:34:52.892914+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892914+0000","last_undegraded":"2024-09-12T02:34:52.892914+0000","last_fullsized":"2024-09-12T02:34:52.892914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888257+0000","last_change":"2024-09-12T02:34:51.888257+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888257+0000","last_undegraded":"2024-09-12T02:34:51.888257+0000","last_fullsized":"2024-09-12T02:34:51.888257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.911000+0000","last_change":"2024-09-12T02:34:52.907743+0000","last_active":"2024-09-12T02:34:53.911000+0000","last_peered":"2024-09-12T02:34:53.911000+0000","last_clean":"2024-09-12T02:34:53.911000+0000","last_became_active":"2024-09-12T02:34:52.907497+0000","last_became_peered":"2024-09-12T02:34:52.907497+0000","last_unstale":"2024-09-12T02:34:53.911000+0000","last_undegraded":"2024-09-12T02:34:53.911000+0000","last_fullsized":"2024-09-12T02:34:53.911000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888252+0000","last_change":"2024-09-12T02:34:51.888252+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888252+0000","last_undegraded":"2024-09-12T02:34:51.888252+0000","last_fullsized":"2024-09-12T02:34:51.888252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922382+0000","last_change":"2024-09-12T02:34:53.917794+0000","last_active":"2024-09-12T02:34:53.922382+0000","last_peered":"2024-09-12T02:34:53.922382+0000","last_clean":"2024-09-12T02:34:53.922382+0000","last_became_active":"2024-09-12T02:34:53.917420+0000","last_became_peered":"2024-09-12T02:34:53.917420+0000","last_unstale":"2024-09-12T02:34:53.922382+0000","last_undegraded":"2024-09-12T02:34:53.922382+0000","last_fullsized":"2024-09-12T02:34:53.922382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888239+0000","last_change":"2024-09-12T02:34:51.888239+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888239+0000","last_undegraded":"2024-09-12T02:34:51.888239+0000","last_fullsized":"2024-09-12T02:34:51.888239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895096+0000","last_change":"2024-09-12T02:34:52.895096+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895096+0000","last_undegraded":"2024-09-12T02:34:52.895096+0000","last_fullsized":"2024-09-12T02:34:52.895096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888007+0000","last_change":"2024-09-12T02:34:51.888007+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888007+0000","last_undegraded":"2024-09-12T02:34:51.888007+0000","last_fullsized":"2024-09-12T02:34:51.888007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933097+0000","last_change":"2024-09-12T02:34:53.930914+0000","last_active":"2024-09-12T02:34:53.933097+0000","last_peered":"2024-09-12T02:34:53.933097+0000","last_clean":"2024-09-12T02:34:53.933097+0000","last_became_active":"2024-09-12T02:34:53.930647+0000","last_became_peered":"2024-09-12T02:34:53.930647+0000","last_unstale":"2024-09-12T02:34:53.933097+0000","last_undegraded":"2024-09-12T02:34:53.933097+0000","last_fullsized":"2024-09-12T02:34:53.933097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.887613+0000","last_change":"2024-09-12T02:34:51.887613+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.887613+0000","last_undegraded":"2024-09-12T02:34:51.887613+0000","last_fullsized":"2024-09-12T02:34:51.887613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.891836+0000","last_change":"2024-09-12T02:34:52.891836+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.891836+0000","last_undegraded":"2024-09-12T02:34:52.891836+0000","last_fullsized":"2024-09-12T02:34:52.891836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.907540+0000","last_change":"2024-09-12T02:34:52.898024+0000","last_active":"2024-09-12T02:34:53.907540+0000","last_peered":"2024-09-12T02:34:53.907540+0000","last_clean":"2024-09-12T02:34:53.907540+0000","last_became_active":"2024-09-12T02:34:52.897771+0000","last_became_peered":"2024-09-12T02:34:52.897771+0000","last_unstale":"2024-09-12T02:34:53.907540+0000","last_undegraded":"2024-09-12T02:34:53.907540+0000","last_fullsized":"2024-09-12T02:34:53.907540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.919349+0000","last_change":"2024-09-12T02:34:53.916828+0000","last_active":"2024-09-12T02:34:53.919349+0000","last_peered":"2024-09-12T02:34:53.919349+0000","last_clean":"2024-09-12T02:34:53.919349+0000","last_became_active":"2024-09-12T02:34:53.916543+0000","last_became_peered":"2024-09-12T02:34:53.916543+0000","last_unstale":"2024-09-12T02:34:53.919349+0000","last_undegraded":"2024-09-12T02:34:53.919349+0000","last_fullsized":"2024-09-12T02:34:53.919349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908630+0000","last_change":"2024-09-12T02:34:52.896981+0000","last_active":"2024-09-12T02:34:53.908630+0000","last_peered":"2024-09-12T02:34:53.908630+0000","last_clean":"2024-09-12T02:34:53.908630+0000","last_became_active":"2024-09-12T02:34:52.896728+0000","last_became_peered":"2024-09-12T02:34:52.896728+0000","last_unstale":"2024-09-12T02:34:53.908630+0000","last_undegraded":"2024-09-12T02:34:53.908630+0000","last_fullsized":"2024-09-12T02:34:53.908630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:51.190888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922569+0000","last_change":"2024-09-12T02:34:53.917338+0000","last_active":"2024-09-12T02:34:53.922569+0000","last_peered":"2024-09-12T02:34:53.922569+0000","last_clean":"2024-09-12T02:34:53.922569+0000","last_became_active":"2024-09-12T02:34:53.917083+0000","last_became_peered":"2024-09-12T02:34:53.917083+0000","last_unstale":"2024-09-12T02:34:53.922569+0000","last_undegraded":"2024-09-12T02:34:53.922569+0000","last_fullsized":"2024-09-12T02:34:53.922569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.903380+0000","last_change":"2024-09-12T02:34:52.899652+0000","last_active":"2024-09-12T02:34:53.903380+0000","last_peered":"2024-09-12T02:34:53.903380+0000","last_clean":"2024-09-12T02:34:53.903380+0000","last_became_active":"2024-09-12T02:34:52.899400+0000","last_became_peered":"2024-09-12T02:34:52.899400+0000","last_unstale":"2024-09-12T02:34:53.903380+0000","last_undegraded":"2024-09-12T02:34:53.903380+0000","last_fullsized":"2024-09-12T02:34:53.903380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.376482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.902019+0000","last_change":"2024-09-12T02:34:52.899954+0000","last_active":"2024-09-12T02:34:52.902019+0000","last_peered":"2024-09-12T02:34:52.902019+0000","last_clean":"2024-09-12T02:34:52.902019+0000","last_became_active":"2024-09-12T02:34:52.899233+0000","last_became_peered":"2024-09-12T02:34:52.899233+0000","last_unstale":"2024-09-12T02:34:52.902019+0000","last_undegraded":"2024-09-12T02:34:52.902019+0000","last_fullsized":"2024-09-12T02:34:52.902019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:03.154855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:51.878505+0000","last_change":"2024-09-12T02:34:51.878505+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.878505+0000","last_undegraded":"2024-09-12T02:34:51.878505+0000","last_fullsized":"2024-09-12T02:34:51.878505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:34:48.399670+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:48.399670+0000","last_peered":"2024-09-12T02:34:48.399670+0000","last_clean":"2024-09-12T02:34:48.399670+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:48.399670+0000","last_undegraded":"2024-09-12T02:34:48.399670+0000","last_fullsized":"2024-09-12T02:34:48.399670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":401408,"data_stored":169442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":425984,"data_stored":182318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":772686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:57.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:57.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.315+0000 7f6b2b0ed640 1 Processor -- start 2024-09-12T02:34:57.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.315+0000 7f6b2b0ed640 1 -- start start 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 0x7f6b240d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b240d30f0 0x7f6b240b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b240b64c0 0x7f6b240cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2406d530 con 0x7f6b240d30f0 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6b240d3690 con 0x7f6b240b64c0 2024-09-12T02:34:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2b0ed640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240d3970 con 0x7f6b2415e5f0 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b240d30f0 0x7f6b240b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b240d30f0 0x7f6b240b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46962/0 (socket says 172.21.15.119:46962) 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 -- 172.21.15.119:0/1663410215 learned_addr learned my addr 172.21.15.119:0/1663410215 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b2968a640 1 --2- 172.21.15.119:0/1663410215 >> v2:172.21.15.153:3300/0 conn(0x7f6b240b64c0 0x7f6b240cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b28e89640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 0x7f6b240d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 -- 172.21.15.119:0/1663410215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 msgr2=0x7f6b240d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 0x7f6b240d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 -- 172.21.15.119:0/1663410215 >> v2:172.21.15.153:3300/0 conn(0x7f6b240b64c0 msgr2=0x7f6b240cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 --2- 172.21.15.119:0/1663410215 >> v2:172.21.15.153:3300/0 conn(0x7f6b240b64c0 0x7f6b240cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b23fff640 1 -- 172.21.15.119:0/1663410215 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2406cee0 con 0x7f6b240d30f0 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.316+0000 7f6b28e89640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 0x7f6b240d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b23fff640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240d30f0 0x7f6b240b5f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b240a23f0 tx=0x7f6b1402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe01a6ddc4e1acdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b237fe640 1 -- 172.21.15.119:0/1663410215 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b14036070 con 0x7f6b240d30f0 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b237fe640 1 -- 172.21.15.119:0/1663410215 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b14031600 con 0x7f6b240d30f0 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b237fe640 1 -- 172.21.15.119:0/1663410215 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140319d0 con 0x7f6b240d30f0 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/1663410215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240d30f0 msgr2=0x7f6b240b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240d30f0 0x7f6b240b5f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b240a23f0 tx=0x7f6b1402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/1663410215 shutdown_connections 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/1663410215 >> v2:172.21.15.153:3300/0 conn(0x7f6b240b64c0 0x7f6b240cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240d30f0 0x7f6b240b5f80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/1663410215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b2415e5f0 0x7f6b240d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/1663410215 >> 172.21.15.119:0/1663410215 conn(0x7f6b2408bfc0 msgr2=0x7f6b240d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/1663410215 shutdown_connections 2024-09-12T02:34:57.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.317+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/1663410215 wait complete. 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 Processor -- start 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 -- start start 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b240d30f0 0x7f6b2415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b2415e5f0 0x7f6b240b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240d5310 con 0x7f6b240b64c0 2024-09-12T02:34:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2415e9d0 con 0x7f6b2415e5f0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.319+0000 7f6b2b0ed640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240cf540 con 0x7f6b240d30f0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46976/0 (socket says 172.21.15.119:46976) 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 -- 172.21.15.119:0/291898765 learned_addr learned my addr 172.21.15.119:0/291898765 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b23fff640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b240d30f0 0x7f6b2415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b2968a640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b2415e5f0 0x7f6b240b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 -- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b240d30f0 msgr2=0x7f6b2415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b240d30f0 0x7f6b2415cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 -- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b2415e5f0 msgr2=0x7f6b240b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b2415e5f0 0x7f6b240b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 -- 172.21.15.119:0/291898765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b240cac80 con 0x7f6b240b64c0 2024-09-12T02:34:57.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b28e89640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c7f0 tx=0x7f6b1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c015070 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c0077c0 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c007b70 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b24160a20 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.320+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b240c9ec0 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.321+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b240ca8b0 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.322+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b1c018070 con 0x7f6b240b64c0 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.322+0000 7f6b217fa640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 0x7f6b0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.322+0000 7f6b23fff640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 0x7f6b0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.322+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f6b1c08aeb0 con 0x7f6b240b64c0 2024-09-12T02:34:57.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.323+0000 7f6b23fff640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 0x7f6b0406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6b14033000 tx=0x7f6b14009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.327+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b1c059110 con 0x7f6b240b64c0 2024-09-12T02:34:57.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.490+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b240c9990 con 0x7f6b0406be60 2024-09-12T02:34:57.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.496+0000 7f6b217fa640 1 -- 172.21.15.119:0/291898765 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7f6b240c9990 con 0x7f6b0406be60 2024-09-12T02:34:57.621 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:57.622 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:57.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.499+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 msgr2=0x7f6b0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.499+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 0x7f6b0406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6b14033000 tx=0x7f6b14009000 comp rx=0 tx=0).stop 2024-09-12T02:34:57.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.499+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 msgr2=0x7f6b240c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.499+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c7f0 tx=0x7f6b1c00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 shutdown_connections 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6b0406be60 0x7f6b0406e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b2415e5f0 0x7f6b240b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b240d30f0 0x7f6b2415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 --2- 172.21.15.119:0/291898765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240b64c0 0x7f6b240c9450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 >> 172.21.15.119:0/291898765 conn(0x7f6b2408bfc0 msgr2=0x7f6b241e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 shutdown_connections 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.500+0000 7f6b2b0ed640 1 -- 172.21.15.119:0/291898765 wait complete. 2024-09-12T02:34:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T02:34:57.191020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220804,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753916,"statfs":{"total":773094113280,"available":772868009984,"internally_reserved":0,"allocated":4669440,"data_stored":2664286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.307387"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894314+0000","last_change":"2024-09-12T02:34:52.894314+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894314+0000","last_undegraded":"2024-09-12T02:34:52.894314+0000","last_fullsized":"2024-09-12T02:34:52.894314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892289+0000","last_change":"2024-09-12T02:34:52.892289+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892289+0000","last_undegraded":"2024-09-12T02:34:52.892289+0000","last_fullsized":"2024-09-12T02:34:52.892289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.927110+0000","last_change":"2024-09-12T02:34:53.925071+0000","last_active":"2024-09-12T02:34:53.927110+0000","last_peered":"2024-09-12T02:34:53.927110+0000","last_clean":"2024-09-12T02:34:53.927110+0000","last_became_active":"2024-09-12T02:34:53.924546+0000","last_became_peered":"2024-09-12T02:34:53.924546+0000","last_unstale":"2024-09-12T02:34:53.927110+0000","last_undegraded":"2024-09-12T02:34:53.927110+0000","last_fullsized":"2024-09-12T02:34:53.927110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928050+0000","last_change":"2024-09-12T02:34:53.926491+0000","last_active":"2024-09-12T02:34:53.928050+0000","last_peered":"2024-09-12T02:34:53.928050+0000","last_clean":"2024-09-12T02:34:53.928050+0000","last_became_active":"2024-09-12T02:34:53.926211+0000","last_became_peered":"2024-09-12T02:34:53.926211+0000","last_unstale":"2024-09-12T02:34:53.928050+0000","last_undegraded":"2024-09-12T02:34:53.928050+0000","last_fullsized":"2024-09-12T02:34:53.928050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923494+0000","last_change":"2024-09-12T02:34:53.931710+0000","last_active":"2024-09-12T02:34:54.923494+0000","last_peered":"2024-09-12T02:34:54.923494+0000","last_clean":"2024-09-12T02:34:54.923494+0000","last_became_active":"2024-09-12T02:34:53.931441+0000","last_became_peered":"2024-09-12T02:34:53.931441+0000","last_unstale":"2024-09-12T02:34:54.923494+0000","last_undegraded":"2024-09-12T02:34:54.923494+0000","last_fullsized":"2024-09-12T02:34:54.923494+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:15.773861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.893487+0000","last_change":"2024-09-12T02:34:52.893487+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.893487+0000","last_undegraded":"2024-09-12T02:34:52.893487+0000","last_fullsized":"2024-09-12T02:34:52.893487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926607+0000","last_change":"2024-09-12T02:34:53.922929+0000","last_active":"2024-09-12T02:34:53.926607+0000","last_peered":"2024-09-12T02:34:53.926607+0000","last_clean":"2024-09-12T02:34:53.926607+0000","last_became_active":"2024-09-12T02:34:53.922520+0000","last_became_peered":"2024-09-12T02:34:53.922520+0000","last_unstale":"2024-09-12T02:34:53.926607+0000","last_undegraded":"2024-09-12T02:34:53.926607+0000","last_fullsized":"2024-09-12T02:34:53.926607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923946+0000","last_change":"2024-09-12T02:34:53.928906+0000","last_active":"2024-09-12T02:34:54.923946+0000","last_peered":"2024-09-12T02:34:54.923946+0000","last_clean":"2024-09-12T02:34:54.923946+0000","last_became_active":"2024-09-12T02:34:53.928621+0000","last_became_peered":"2024-09-12T02:34:53.928621+0000","last_unstale":"2024-09-12T02:34:54.923946+0000","last_undegraded":"2024-09-12T02:34:54.923946+0000","last_fullsized":"2024-09-12T02:34:54.923946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:47.050346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923907+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923907+0000","last_peered":"2024-09-12T02:34:54.923907+0000","last_clean":"2024-09-12T02:34:54.923907+0000","last_became_active":"2024-09-12T02:34:53.924943+0000","last_became_peered":"2024-09-12T02:34:53.924943+0000","last_unstale":"2024-09-12T02:34:54.923907+0000","last_undegraded":"2024-09-12T02:34:54.923907+0000","last_fullsized":"2024-09-12T02:34:54.923907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:59.114212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922349+0000","last_change":"2024-09-12T02:34:53.916964+0000","last_active":"2024-09-12T02:34:53.922349+0000","last_peered":"2024-09-12T02:34:53.922349+0000","last_clean":"2024-09-12T02:34:53.922349+0000","last_became_active":"2024-09-12T02:34:53.916680+0000","last_became_peered":"2024-09-12T02:34:53.916680+0000","last_unstale":"2024-09-12T02:34:53.922349+0000","last_undegraded":"2024-09-12T02:34:53.922349+0000","last_fullsized":"2024-09-12T02:34:53.922349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923582+0000","last_change":"2024-09-12T02:34:53.929140+0000","last_active":"2024-09-12T02:34:54.923582+0000","last_peered":"2024-09-12T02:34:54.923582+0000","last_clean":"2024-09-12T02:34:54.923582+0000","last_became_active":"2024-09-12T02:34:53.928842+0000","last_became_peered":"2024-09-12T02:34:53.928842+0000","last_unstale":"2024-09-12T02:34:54.923582+0000","last_undegraded":"2024-09-12T02:34:54.923582+0000","last_fullsized":"2024-09-12T02:34:54.923582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.169910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917126+0000","last_change":"2024-09-12T02:34:53.906988+0000","last_active":"2024-09-12T02:34:54.917126+0000","last_peered":"2024-09-12T02:34:54.917126+0000","last_clean":"2024-09-12T02:34:54.917126+0000","last_became_active":"2024-09-12T02:34:53.906697+0000","last_became_peered":"2024-09-12T02:34:53.906697+0000","last_unstale":"2024-09-12T02:34:54.917126+0000","last_undegraded":"2024-09-12T02:34:54.917126+0000","last_fullsized":"2024-09-12T02:34:54.917126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923527+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923527+0000","last_peered":"2024-09-12T02:34:54.923527+0000","last_clean":"2024-09-12T02:34:54.923527+0000","last_became_active":"2024-09-12T02:34:53.925046+0000","last_became_peered":"2024-09-12T02:34:53.925046+0000","last_unstale":"2024-09-12T02:34:54.923527+0000","last_undegraded":"2024-09-12T02:34:54.923527+0000","last_fullsized":"2024-09-12T02:34:54.923527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:30.672733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.924778+0000","last_change":"2024-09-12T02:34:53.922618+0000","last_active":"2024-09-12T02:34:53.924778+0000","last_peered":"2024-09-12T02:34:53.924778+0000","last_clean":"2024-09-12T02:34:53.924778+0000","last_became_active":"2024-09-12T02:34:53.922054+0000","last_became_peered":"2024-09-12T02:34:53.922054+0000","last_unstale":"2024-09-12T02:34:53.924778+0000","last_undegraded":"2024-09-12T02:34:53.924778+0000","last_fullsized":"2024-09-12T02:34:53.924778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.924710+0000","last_change":"2024-09-12T02:34:53.923038+0000","last_active":"2024-09-12T02:34:53.924710+0000","last_peered":"2024-09-12T02:34:53.924710+0000","last_clean":"2024-09-12T02:34:53.924710+0000","last_became_active":"2024-09-12T02:34:53.922649+0000","last_became_peered":"2024-09-12T02:34:53.922649+0000","last_unstale":"2024-09-12T02:34:53.924710+0000","last_undegraded":"2024-09-12T02:34:53.924710+0000","last_fullsized":"2024-09-12T02:34:53.924710+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914563+0000","last_change":"2024-09-12T02:34:53.907701+0000","last_active":"2024-09-12T02:34:53.914563+0000","last_peered":"2024-09-12T02:34:53.914563+0000","last_clean":"2024-09-12T02:34:53.914563+0000","last_became_active":"2024-09-12T02:34:53.907425+0000","last_became_peered":"2024-09-12T02:34:53.907425+0000","last_unstale":"2024-09-12T02:34:53.914563+0000","last_undegraded":"2024-09-12T02:34:53.914563+0000","last_fullsized":"2024-09-12T02:34:53.914563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:21.915931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914760+0000","last_change":"2024-09-12T02:34:53.908746+0000","last_active":"2024-09-12T02:34:53.914760+0000","last_peered":"2024-09-12T02:34:53.914760+0000","last_clean":"2024-09-12T02:34:53.914760+0000","last_became_active":"2024-09-12T02:34:53.908484+0000","last_became_peered":"2024-09-12T02:34:53.908484+0000","last_unstale":"2024-09-12T02:34:53.914760+0000","last_undegraded":"2024-09-12T02:34:53.914760+0000","last_fullsized":"2024-09-12T02:34:53.914760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:03.587388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923665+0000","last_change":"2024-09-12T02:34:53.926067+0000","last_active":"2024-09-12T02:34:54.923665+0000","last_peered":"2024-09-12T02:34:54.923665+0000","last_clean":"2024-09-12T02:34:54.923665+0000","last_became_active":"2024-09-12T02:34:53.925776+0000","last_became_peered":"2024-09-12T02:34:53.925776+0000","last_unstale":"2024-09-12T02:34:54.923665+0000","last_undegraded":"2024-09-12T02:34:54.923665+0000","last_fullsized":"2024-09-12T02:34:54.923665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:41.377035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917344+0000","last_change":"2024-09-12T02:34:53.919856+0000","last_active":"2024-09-12T02:34:54.917344+0000","last_peered":"2024-09-12T02:34:54.917344+0000","last_clean":"2024-09-12T02:34:54.917344+0000","last_became_active":"2024-09-12T02:34:53.918841+0000","last_became_peered":"2024-09-12T02:34:53.918841+0000","last_unstale":"2024-09-12T02:34:54.917344+0000","last_undegraded":"2024-09-12T02:34:54.917344+0000","last_fullsized":"2024-09-12T02:34:54.917344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923208+0000","last_change":"2024-09-12T02:34:53.921158+0000","last_active":"2024-09-12T02:34:53.923208+0000","last_peered":"2024-09-12T02:34:53.923208+0000","last_clean":"2024-09-12T02:34:53.923208+0000","last_became_active":"2024-09-12T02:34:53.920889+0000","last_became_peered":"2024-09-12T02:34:53.920889+0000","last_unstale":"2024-09-12T02:34:53.923208+0000","last_undegraded":"2024-09-12T02:34:53.923208+0000","last_fullsized":"2024-09-12T02:34:53.923208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923956+0000","last_change":"2024-09-12T02:34:53.920936+0000","last_active":"2024-09-12T02:34:53.923956+0000","last_peered":"2024-09-12T02:34:53.923956+0000","last_clean":"2024-09-12T02:34:53.923956+0000","last_became_active":"2024-09-12T02:34:53.920663+0000","last_became_peered":"2024-09-12T02:34:53.920663+0000","last_unstale":"2024-09-12T02:34:53.923956+0000","last_undegraded":"2024-09-12T02:34:53.923956+0000","last_fullsized":"2024-09-12T02:34:53.923956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:39.371309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933174+0000","last_change":"2024-09-12T02:34:53.931129+0000","last_active":"2024-09-12T02:34:53.933174+0000","last_peered":"2024-09-12T02:34:53.933174+0000","last_clean":"2024-09-12T02:34:53.933174+0000","last_became_active":"2024-09-12T02:34:53.930795+0000","last_became_peered":"2024-09-12T02:34:53.930795+0000","last_unstale":"2024-09-12T02:34:53.933174+0000","last_undegraded":"2024-09-12T02:34:53.933174+0000","last_fullsized":"2024-09-12T02:34:53.933174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922936+0000","last_change":"2024-09-12T02:34:53.919417+0000","last_active":"2024-09-12T02:34:53.922936+0000","last_peered":"2024-09-12T02:34:53.922936+0000","last_clean":"2024-09-12T02:34:53.922936+0000","last_became_active":"2024-09-12T02:34:53.919134+0000","last_became_peered":"2024-09-12T02:34:53.919134+0000","last_unstale":"2024-09-12T02:34:53.922936+0000","last_undegraded":"2024-09-12T02:34:53.922936+0000","last_fullsized":"2024-09-12T02:34:53.922936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:00.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923830+0000","last_change":"2024-09-12T02:34:53.932447+0000","last_active":"2024-09-12T02:34:54.923830+0000","last_peered":"2024-09-12T02:34:54.923830+0000","last_clean":"2024-09-12T02:34:54.923830+0000","last_became_active":"2024-09-12T02:34:53.931915+0000","last_became_peered":"2024-09-12T02:34:53.931915+0000","last_unstale":"2024-09-12T02:34:54.923830+0000","last_undegraded":"2024-09-12T02:34:54.923830+0000","last_fullsized":"2024-09-12T02:34:54.923830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:52.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923263+0000","last_change":"2024-09-12T02:34:53.919705+0000","last_active":"2024-09-12T02:34:53.923263+0000","last_peered":"2024-09-12T02:34:53.923263+0000","last_clean":"2024-09-12T02:34:53.923263+0000","last_became_active":"2024-09-12T02:34:53.919433+0000","last_became_peered":"2024-09-12T02:34:53.919433+0000","last_unstale":"2024-09-12T02:34:53.923263+0000","last_undegraded":"2024-09-12T02:34:53.923263+0000","last_fullsized":"2024-09-12T02:34:53.923263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:10.620223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921150+0000","last_change":"2024-09-12T02:34:53.914329+0000","last_active":"2024-09-12T02:34:53.921150+0000","last_peered":"2024-09-12T02:34:53.921150+0000","last_clean":"2024-09-12T02:34:53.921150+0000","last_became_active":"2024-09-12T02:34:53.914049+0000","last_became_peered":"2024-09-12T02:34:53.914049+0000","last_unstale":"2024-09-12T02:34:53.921150+0000","last_undegraded":"2024-09-12T02:34:53.921150+0000","last_fullsized":"2024-09-12T02:34:53.921150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.975603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921695+0000","last_change":"2024-09-12T02:34:53.919485+0000","last_active":"2024-09-12T02:34:53.921695+0000","last_peered":"2024-09-12T02:34:53.921695+0000","last_clean":"2024-09-12T02:34:53.921695+0000","last_became_active":"2024-09-12T02:34:53.919198+0000","last_became_peered":"2024-09-12T02:34:53.919198+0000","last_unstale":"2024-09-12T02:34:53.921695+0000","last_undegraded":"2024-09-12T02:34:53.921695+0000","last_fullsized":"2024-09-12T02:34:53.921695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922663+0000","last_change":"2024-09-12T02:34:53.918077+0000","last_active":"2024-09-12T02:34:53.922663+0000","last_peered":"2024-09-12T02:34:53.922663+0000","last_clean":"2024-09-12T02:34:53.922663+0000","last_became_active":"2024-09-12T02:34:53.917730+0000","last_became_peered":"2024-09-12T02:34:53.917730+0000","last_unstale":"2024-09-12T02:34:53.922663+0000","last_undegraded":"2024-09-12T02:34:53.922663+0000","last_fullsized":"2024-09-12T02:34:53.922663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933513+0000","last_change":"2024-09-12T02:34:53.931065+0000","last_active":"2024-09-12T02:34:53.933513+0000","last_peered":"2024-09-12T02:34:53.933513+0000","last_clean":"2024-09-12T02:34:53.933513+0000","last_became_active":"2024-09-12T02:34:53.930797+0000","last_became_peered":"2024-09-12T02:34:53.930797+0000","last_unstale":"2024-09-12T02:34:53.933513+0000","last_undegraded":"2024-09-12T02:34:53.933513+0000","last_fullsized":"2024-09-12T02:34:53.933513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936684+0000","last_change":"2024-09-12T02:34:52.905869+0000","last_active":"2024-09-12T02:34:53.936684+0000","last_peered":"2024-09-12T02:34:53.936684+0000","last_clean":"2024-09-12T02:34:53.936684+0000","last_became_active":"2024-09-12T02:34:52.905438+0000","last_became_peered":"2024-09-12T02:34:52.905438+0000","last_unstale":"2024-09-12T02:34:53.936684+0000","last_undegraded":"2024-09-12T02:34:53.936684+0000","last_fullsized":"2024-09-12T02:34:53.936684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:37.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928019+0000","last_change":"2024-09-12T02:34:53.925843+0000","last_active":"2024-09-12T02:34:53.928019+0000","last_peered":"2024-09-12T02:34:53.928019+0000","last_clean":"2024-09-12T02:34:53.928019+0000","last_became_active":"2024-09-12T02:34:53.925579+0000","last_became_peered":"2024-09-12T02:34:53.925579+0000","last_unstale":"2024-09-12T02:34:53.928019+0000","last_undegraded":"2024-09-12T02:34:53.928019+0000","last_fullsized":"2024-09-12T02:34:53.928019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926540+0000","last_change":"2024-09-12T02:34:52.897888+0000","last_active":"2024-09-12T02:34:53.926540+0000","last_peered":"2024-09-12T02:34:53.926540+0000","last_clean":"2024-09-12T02:34:53.926540+0000","last_became_active":"2024-09-12T02:34:52.897621+0000","last_became_peered":"2024-09-12T02:34:52.897621+0000","last_unstale":"2024-09-12T02:34:53.926540+0000","last_undegraded":"2024-09-12T02:34:53.926540+0000","last_fullsized":"2024-09-12T02:34:53.926540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917593+0000","last_change":"2024-09-12T02:34:53.906622+0000","last_active":"2024-09-12T02:34:54.917593+0000","last_peered":"2024-09-12T02:34:54.917593+0000","last_clean":"2024-09-12T02:34:54.917593+0000","last_became_active":"2024-09-12T02:34:53.906258+0000","last_became_peered":"2024-09-12T02:34:53.906258+0000","last_unstale":"2024-09-12T02:34:54.917593+0000","last_undegraded":"2024-09-12T02:34:54.917593+0000","last_fullsized":"2024-09-12T02:34:54.917593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.931447+0000","last_change":"2024-09-12T02:34:52.907910+0000","last_active":"2024-09-12T02:34:53.931447+0000","last_peered":"2024-09-12T02:34:53.931447+0000","last_clean":"2024-09-12T02:34:53.931447+0000","last_became_active":"2024-09-12T02:34:52.907702+0000","last_became_peered":"2024-09-12T02:34:52.907702+0000","last_unstale":"2024-09-12T02:34:53.931447+0000","last_undegraded":"2024-09-12T02:34:53.931447+0000","last_fullsized":"2024-09-12T02:34:53.931447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894660+0000","last_change":"2024-09-12T02:34:52.894660+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894660+0000","last_undegraded":"2024-09-12T02:34:52.894660+0000","last_fullsized":"2024-09-12T02:34:52.894660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918055+0000","last_change":"2024-09-12T02:34:52.901444+0000","last_active":"2024-09-12T02:34:54.918055+0000","last_peered":"2024-09-12T02:34:54.918055+0000","last_clean":"2024-09-12T02:34:54.918055+0000","last_became_active":"2024-09-12T02:34:52.901160+0000","last_became_peered":"2024-09-12T02:34:52.901160+0000","last_unstale":"2024-09-12T02:34:54.918055+0000","last_undegraded":"2024-09-12T02:34:54.918055+0000","last_fullsized":"2024-09-12T02:34:54.918055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.925209+0000","last_change":"2024-09-12T02:34:53.919992+0000","last_active":"2024-09-12T02:34:53.925209+0000","last_peered":"2024-09-12T02:34:53.925209+0000","last_clean":"2024-09-12T02:34:53.925209+0000","last_became_active":"2024-09-12T02:34:53.919720+0000","last_became_peered":"2024-09-12T02:34:53.919720+0000","last_unstale":"2024-09-12T02:34:53.925209+0000","last_undegraded":"2024-09-12T02:34:53.925209+0000","last_fullsized":"2024-09-12T02:34:53.925209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923722+0000","last_change":"2024-09-12T02:34:52.904482+0000","last_active":"2024-09-12T02:34:54.923722+0000","last_peered":"2024-09-12T02:34:54.923722+0000","last_clean":"2024-09-12T02:34:54.923722+0000","last_became_active":"2024-09-12T02:34:52.904051+0000","last_became_peered":"2024-09-12T02:34:52.904051+0000","last_unstale":"2024-09-12T02:34:54.923722+0000","last_undegraded":"2024-09-12T02:34:54.923722+0000","last_fullsized":"2024-09-12T02:34:54.923722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:19.941352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923728+0000","last_change":"2024-09-12T02:34:53.925259+0000","last_active":"2024-09-12T02:34:54.923728+0000","last_peered":"2024-09-12T02:34:54.923728+0000","last_clean":"2024-09-12T02:34:54.923728+0000","last_became_active":"2024-09-12T02:34:53.924603+0000","last_became_peered":"2024-09-12T02:34:53.924603+0000","last_unstale":"2024-09-12T02:34:54.923728+0000","last_undegraded":"2024-09-12T02:34:54.923728+0000","last_fullsized":"2024-09-12T02:34:54.923728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:59.262447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936442+0000","last_change":"2024-09-12T02:34:52.904917+0000","last_active":"2024-09-12T02:34:53.936442+0000","last_peered":"2024-09-12T02:34:53.936442+0000","last_clean":"2024-09-12T02:34:53.936442+0000","last_became_active":"2024-09-12T02:34:52.904650+0000","last_became_peered":"2024-09-12T02:34:52.904650+0000","last_unstale":"2024-09-12T02:34:53.936442+0000","last_undegraded":"2024-09-12T02:34:53.936442+0000","last_fullsized":"2024-09-12T02:34:53.936442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:09.615662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917631+0000","last_change":"2024-09-12T02:34:53.930753+0000","last_active":"2024-09-12T02:34:54.917631+0000","last_peered":"2024-09-12T02:34:54.917631+0000","last_clean":"2024-09-12T02:34:54.917631+0000","last_became_active":"2024-09-12T02:34:53.930309+0000","last_became_peered":"2024-09-12T02:34:53.930309+0000","last_unstale":"2024-09-12T02:34:54.917631+0000","last_undegraded":"2024-09-12T02:34:54.917631+0000","last_fullsized":"2024-09-12T02:34:54.917631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.020340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.910539+0000","last_change":"2024-09-12T02:34:52.904914+0000","last_active":"2024-09-12T02:34:53.910539+0000","last_peered":"2024-09-12T02:34:53.910539+0000","last_clean":"2024-09-12T02:34:53.910539+0000","last_became_active":"2024-09-12T02:34:52.904645+0000","last_became_peered":"2024-09-12T02:34:52.904645+0000","last_unstale":"2024-09-12T02:34:53.910539+0000","last_undegraded":"2024-09-12T02:34:53.910539+0000","last_fullsized":"2024-09-12T02:34:53.910539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895781+0000","last_change":"2024-09-12T02:34:52.895781+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895781+0000","last_undegraded":"2024-09-12T02:34:52.895781+0000","last_fullsized":"2024-09-12T02:34:52.895781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916552+0000","last_change":"2024-09-12T02:34:52.902522+0000","last_active":"2024-09-12T02:34:54.916552+0000","last_peered":"2024-09-12T02:34:54.916552+0000","last_clean":"2024-09-12T02:34:54.916552+0000","last_became_active":"2024-09-12T02:34:52.902227+0000","last_became_peered":"2024-09-12T02:34:52.902227+0000","last_unstale":"2024-09-12T02:34:54.916552+0000","last_undegraded":"2024-09-12T02:34:54.916552+0000","last_fullsized":"2024-09-12T02:34:54.916552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901806+0000","last_change":"2024-09-12T02:34:52.899622+0000","last_active":"2024-09-12T02:34:52.901806+0000","last_peered":"2024-09-12T02:34:52.901806+0000","last_clean":"2024-09-12T02:34:52.901806+0000","last_became_active":"2024-09-12T02:34:52.899362+0000","last_became_peered":"2024-09-12T02:34:52.899362+0000","last_unstale":"2024-09-12T02:34:52.901806+0000","last_undegraded":"2024-09-12T02:34:52.901806+0000","last_fullsized":"2024-09-12T02:34:52.901806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.833616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.920416+0000","last_change":"2024-09-12T02:34:53.916634+0000","last_active":"2024-09-12T02:34:53.920416+0000","last_peered":"2024-09-12T02:34:53.920416+0000","last_clean":"2024-09-12T02:34:53.920416+0000","last_became_active":"2024-09-12T02:34:53.916359+0000","last_became_peered":"2024-09-12T02:34:53.916359+0000","last_unstale":"2024-09-12T02:34:53.920416+0000","last_undegraded":"2024-09-12T02:34:53.920416+0000","last_fullsized":"2024-09-12T02:34:53.920416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:41.622991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924062+0000","last_change":"2024-09-12T02:34:52.906658+0000","last_active":"2024-09-12T02:34:54.924062+0000","last_peered":"2024-09-12T02:34:54.924062+0000","last_clean":"2024-09-12T02:34:54.924062+0000","last_became_active":"2024-09-12T02:34:52.906388+0000","last_became_peered":"2024-09-12T02:34:52.906388+0000","last_unstale":"2024-09-12T02:34:54.924062+0000","last_undegraded":"2024-09-12T02:34:54.924062+0000","last_fullsized":"2024-09-12T02:34:54.924062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922418+0000","last_change":"2024-09-12T02:34:53.917563+0000","last_active":"2024-09-12T02:34:53.922418+0000","last_peered":"2024-09-12T02:34:53.922418+0000","last_clean":"2024-09-12T02:34:53.922418+0000","last_became_active":"2024-09-12T02:34:53.917297+0000","last_became_peered":"2024-09-12T02:34:53.917297+0000","last_unstale":"2024-09-12T02:34:53.922418+0000","last_undegraded":"2024-09-12T02:34:53.922418+0000","last_fullsized":"2024-09-12T02:34:53.922418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923999+0000","last_change":"2024-09-12T02:34:52.905778+0000","last_active":"2024-09-12T02:34:54.923999+0000","last_peered":"2024-09-12T02:34:54.923999+0000","last_clean":"2024-09-12T02:34:54.923999+0000","last_became_active":"2024-09-12T02:34:52.905458+0000","last_became_peered":"2024-09-12T02:34:52.905458+0000","last_unstale":"2024-09-12T02:34:54.923999+0000","last_undegraded":"2024-09-12T02:34:54.923999+0000","last_fullsized":"2024-09-12T02:34:54.923999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:41.923326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917105+0000","last_change":"2024-09-12T02:34:53.918308+0000","last_active":"2024-09-12T02:34:54.917105+0000","last_peered":"2024-09-12T02:34:54.917105+0000","last_clean":"2024-09-12T02:34:54.917105+0000","last_became_active":"2024-09-12T02:34:53.918025+0000","last_became_peered":"2024-09-12T02:34:53.918025+0000","last_unstale":"2024-09-12T02:34:54.917105+0000","last_undegraded":"2024-09-12T02:34:54.917105+0000","last_fullsized":"2024-09-12T02:34:54.917105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901833+0000","last_change":"2024-09-12T02:34:52.899558+0000","last_active":"2024-09-12T02:34:52.901833+0000","last_peered":"2024-09-12T02:34:52.901833+0000","last_clean":"2024-09-12T02:34:52.901833+0000","last_became_active":"2024-09-12T02:34:52.899304+0000","last_became_peered":"2024-09-12T02:34:52.899304+0000","last_unstale":"2024-09-12T02:34:52.901833+0000","last_undegraded":"2024-09-12T02:34:52.901833+0000","last_fullsized":"2024-09-12T02:34:52.901833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:53.361266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926578+0000","last_change":"2024-09-12T02:34:53.922769+0000","last_active":"2024-09-12T02:34:53.926578+0000","last_peered":"2024-09-12T02:34:53.926578+0000","last_clean":"2024-09-12T02:34:53.926578+0000","last_became_active":"2024-09-12T02:34:53.922500+0000","last_became_peered":"2024-09-12T02:34:53.922500+0000","last_unstale":"2024-09-12T02:34:53.926578+0000","last_undegraded":"2024-09-12T02:34:53.926578+0000","last_fullsized":"2024-09-12T02:34:53.926578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.905029+0000","last_change":"2024-09-12T02:34:52.902405+0000","last_active":"2024-09-12T02:34:52.905029+0000","last_peered":"2024-09-12T02:34:52.905029+0000","last_clean":"2024-09-12T02:34:52.905029+0000","last_became_active":"2024-09-12T02:34:52.902161+0000","last_became_peered":"2024-09-12T02:34:52.902161+0000","last_unstale":"2024-09-12T02:34:52.905029+0000","last_undegraded":"2024-09-12T02:34:52.905029+0000","last_fullsized":"2024-09-12T02:34:52.905029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.412066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892700+0000","last_change":"2024-09-12T02:34:52.892700+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892700+0000","last_undegraded":"2024-09-12T02:34:52.892700+0000","last_fullsized":"2024-09-12T02:34:52.892700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.913762+0000","last_change":"2024-09-12T02:34:52.907610+0000","last_active":"2024-09-12T02:34:53.913762+0000","last_peered":"2024-09-12T02:34:53.913762+0000","last_clean":"2024-09-12T02:34:53.913762+0000","last_became_active":"2024-09-12T02:34:52.907304+0000","last_became_peered":"2024-09-12T02:34:52.907304+0000","last_unstale":"2024-09-12T02:34:53.913762+0000","last_undegraded":"2024-09-12T02:34:53.913762+0000","last_fullsized":"2024-09-12T02:34:53.913762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921635+0000","last_change":"2024-09-12T02:34:53.919053+0000","last_active":"2024-09-12T02:34:53.921635+0000","last_peered":"2024-09-12T02:34:53.921635+0000","last_clean":"2024-09-12T02:34:53.921635+0000","last_became_active":"2024-09-12T02:34:53.918759+0000","last_became_peered":"2024-09-12T02:34:53.918759+0000","last_unstale":"2024-09-12T02:34:53.921635+0000","last_undegraded":"2024-09-12T02:34:53.921635+0000","last_fullsized":"2024-09-12T02:34:53.921635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:50.569216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.902502+0000","last_change":"2024-09-12T02:34:52.905674+0000","last_active":"2024-09-12T02:34:53.902502+0000","last_peered":"2024-09-12T02:34:53.902502+0000","last_clean":"2024-09-12T02:34:53.902502+0000","last_became_active":"2024-09-12T02:34:52.905397+0000","last_became_peered":"2024-09-12T02:34:52.905397+0000","last_unstale":"2024-09-12T02:34:53.902502+0000","last_undegraded":"2024-09-12T02:34:53.902502+0000","last_fullsized":"2024-09-12T02:34:53.902502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895448+0000","last_change":"2024-09-12T02:34:52.895448+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895448+0000","last_undegraded":"2024-09-12T02:34:52.895448+0000","last_fullsized":"2024-09-12T02:34:52.895448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.937384+0000","last_change":"2024-09-12T02:34:52.907996+0000","last_active":"2024-09-12T02:34:53.937384+0000","last_peered":"2024-09-12T02:34:53.937384+0000","last_clean":"2024-09-12T02:34:53.937384+0000","last_became_active":"2024-09-12T02:34:52.907553+0000","last_became_peered":"2024-09-12T02:34:52.907553+0000","last_unstale":"2024-09-12T02:34:53.937384+0000","last_undegraded":"2024-09-12T02:34:53.937384+0000","last_fullsized":"2024-09-12T02:34:53.937384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:59.248306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892914+0000","last_change":"2024-09-12T02:34:52.892914+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892914+0000","last_undegraded":"2024-09-12T02:34:52.892914+0000","last_fullsized":"2024-09-12T02:34:52.892914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924064+0000","last_change":"2024-09-12T02:34:52.907895+0000","last_active":"2024-09-12T02:34:54.924064+0000","last_peered":"2024-09-12T02:34:54.924064+0000","last_clean":"2024-09-12T02:34:54.924064+0000","last_became_active":"2024-09-12T02:34:52.907619+0000","last_became_peered":"2024-09-12T02:34:52.907619+0000","last_unstale":"2024-09-12T02:34:54.924064+0000","last_undegraded":"2024-09-12T02:34:54.924064+0000","last_fullsized":"2024-09-12T02:34:54.924064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923917+0000","last_change":"2024-09-12T02:34:53.929988+0000","last_active":"2024-09-12T02:34:54.923917+0000","last_peered":"2024-09-12T02:34:54.923917+0000","last_clean":"2024-09-12T02:34:54.923917+0000","last_became_active":"2024-09-12T02:34:53.929710+0000","last_became_peered":"2024-09-12T02:34:53.929710+0000","last_unstale":"2024-09-12T02:34:54.923917+0000","last_undegraded":"2024-09-12T02:34:54.923917+0000","last_fullsized":"2024-09-12T02:34:54.923917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:45.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917705+0000","last_change":"2024-09-12T02:34:52.905107+0000","last_active":"2024-09-12T02:34:54.917705+0000","last_peered":"2024-09-12T02:34:54.917705+0000","last_clean":"2024-09-12T02:34:54.917705+0000","last_became_active":"2024-09-12T02:34:52.904818+0000","last_became_peered":"2024-09-12T02:34:52.904818+0000","last_unstale":"2024-09-12T02:34:54.917705+0000","last_undegraded":"2024-09-12T02:34:54.917705+0000","last_fullsized":"2024-09-12T02:34:54.917705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917432+0000","last_change":"2024-09-12T02:34:53.919967+0000","last_active":"2024-09-12T02:34:54.917432+0000","last_peered":"2024-09-12T02:34:54.917432+0000","last_clean":"2024-09-12T02:34:54.917432+0000","last_became_active":"2024-09-12T02:34:53.919660+0000","last_became_peered":"2024-09-12T02:34:53.919660+0000","last_unstale":"2024-09-12T02:34:54.917432+0000","last_undegraded":"2024-09-12T02:34:54.917432+0000","last_fullsized":"2024-09-12T02:34:54.917432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888257+0000","last_change":"2024-09-12T02:34:51.888257+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888257+0000","last_undegraded":"2024-09-12T02:34:51.888257+0000","last_fullsized":"2024-09-12T02:34:51.888257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.911000+0000","last_change":"2024-09-12T02:34:52.907743+0000","last_active":"2024-09-12T02:34:53.911000+0000","last_peered":"2024-09-12T02:34:53.911000+0000","last_clean":"2024-09-12T02:34:53.911000+0000","last_became_active":"2024-09-12T02:34:52.907497+0000","last_became_peered":"2024-09-12T02:34:52.907497+0000","last_unstale":"2024-09-12T02:34:53.911000+0000","last_undegraded":"2024-09-12T02:34:53.911000+0000","last_fullsized":"2024-09-12T02:34:53.911000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921075+0000","last_change":"2024-09-12T02:34:53.920142+0000","last_active":"2024-09-12T02:34:53.921075+0000","last_peered":"2024-09-12T02:34:53.921075+0000","last_clean":"2024-09-12T02:34:53.921075+0000","last_became_active":"2024-09-12T02:34:53.919863+0000","last_became_peered":"2024-09-12T02:34:53.919863+0000","last_unstale":"2024-09-12T02:34:53.921075+0000","last_undegraded":"2024-09-12T02:34:53.921075+0000","last_fullsized":"2024-09-12T02:34:53.921075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888252+0000","last_change":"2024-09-12T02:34:51.888252+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888252+0000","last_undegraded":"2024-09-12T02:34:51.888252+0000","last_fullsized":"2024-09-12T02:34:51.888252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922382+0000","last_change":"2024-09-12T02:34:53.917794+0000","last_active":"2024-09-12T02:34:53.922382+0000","last_peered":"2024-09-12T02:34:53.922382+0000","last_clean":"2024-09-12T02:34:53.922382+0000","last_became_active":"2024-09-12T02:34:53.917420+0000","last_became_peered":"2024-09-12T02:34:53.917420+0000","last_unstale":"2024-09-12T02:34:53.922382+0000","last_undegraded":"2024-09-12T02:34:53.922382+0000","last_fullsized":"2024-09-12T02:34:53.922382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888239+0000","last_change":"2024-09-12T02:34:51.888239+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888239+0000","last_undegraded":"2024-09-12T02:34:51.888239+0000","last_fullsized":"2024-09-12T02:34:51.888239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923653+0000","last_change":"2024-09-12T02:34:53.924920+0000","last_active":"2024-09-12T02:34:54.923653+0000","last_peered":"2024-09-12T02:34:54.923653+0000","last_clean":"2024-09-12T02:34:54.923653+0000","last_became_active":"2024-09-12T02:34:53.924608+0000","last_became_peered":"2024-09-12T02:34:53.924608+0000","last_unstale":"2024-09-12T02:34:54.923653+0000","last_undegraded":"2024-09-12T02:34:54.923653+0000","last_fullsized":"2024-09-12T02:34:54.923653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:44.806726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908337+0000","last_change":"2024-09-12T02:34:52.897781+0000","last_active":"2024-09-12T02:34:53.908337+0000","last_peered":"2024-09-12T02:34:53.908337+0000","last_clean":"2024-09-12T02:34:53.908337+0000","last_became_active":"2024-09-12T02:34:52.897505+0000","last_became_peered":"2024-09-12T02:34:52.897505+0000","last_unstale":"2024-09-12T02:34:53.908337+0000","last_undegraded":"2024-09-12T02:34:53.908337+0000","last_fullsized":"2024-09-12T02:34:53.908337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:38.366747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895096+0000","last_change":"2024-09-12T02:34:52.895096+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895096+0000","last_undegraded":"2024-09-12T02:34:52.895096+0000","last_fullsized":"2024-09-12T02:34:52.895096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888007+0000","last_change":"2024-09-12T02:34:51.888007+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888007+0000","last_undegraded":"2024-09-12T02:34:51.888007+0000","last_fullsized":"2024-09-12T02:34:51.888007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933097+0000","last_change":"2024-09-12T02:34:53.930914+0000","last_active":"2024-09-12T02:34:53.933097+0000","last_peered":"2024-09-12T02:34:53.933097+0000","last_clean":"2024-09-12T02:34:53.933097+0000","last_became_active":"2024-09-12T02:34:53.930647+0000","last_became_peered":"2024-09-12T02:34:53.930647+0000","last_unstale":"2024-09-12T02:34:53.933097+0000","last_undegraded":"2024-09-12T02:34:53.933097+0000","last_fullsized":"2024-09-12T02:34:53.933097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924162+0000","last_change":"2024-09-12T02:34:52.905872+0000","last_active":"2024-09-12T02:34:54.924162+0000","last_peered":"2024-09-12T02:34:54.924162+0000","last_clean":"2024-09-12T02:34:54.924162+0000","last_became_active":"2024-09-12T02:34:52.905610+0000","last_became_peered":"2024-09-12T02:34:52.905610+0000","last_unstale":"2024-09-12T02:34:54.924162+0000","last_undegraded":"2024-09-12T02:34:54.924162+0000","last_fullsized":"2024-09-12T02:34:54.924162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:20.308041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.920439+0000","last_change":"2024-09-12T02:34:53.916708+0000","last_active":"2024-09-12T02:34:53.920439+0000","last_peered":"2024-09-12T02:34:53.920439+0000","last_clean":"2024-09-12T02:34:53.920439+0000","last_became_active":"2024-09-12T02:34:53.916406+0000","last_became_peered":"2024-09-12T02:34:53.916406+0000","last_unstale":"2024-09-12T02:34:53.920439+0000","last_undegraded":"2024-09-12T02:34:53.920439+0000","last_fullsized":"2024-09-12T02:34:53.920439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:30.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.887613+0000","last_change":"2024-09-12T02:34:51.887613+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.887613+0000","last_undegraded":"2024-09-12T02:34:51.887613+0000","last_fullsized":"2024-09-12T02:34:51.887613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.891836+0000","last_change":"2024-09-12T02:34:52.891836+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.891836+0000","last_undegraded":"2024-09-12T02:34:52.891836+0000","last_fullsized":"2024-09-12T02:34:52.891836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.907540+0000","last_change":"2024-09-12T02:34:52.898024+0000","last_active":"2024-09-12T02:34:53.907540+0000","last_peered":"2024-09-12T02:34:53.907540+0000","last_clean":"2024-09-12T02:34:53.907540+0000","last_became_active":"2024-09-12T02:34:52.897771+0000","last_became_peered":"2024-09-12T02:34:52.897771+0000","last_unstale":"2024-09-12T02:34:53.907540+0000","last_undegraded":"2024-09-12T02:34:53.907540+0000","last_fullsized":"2024-09-12T02:34:53.907540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.919349+0000","last_change":"2024-09-12T02:34:53.916828+0000","last_active":"2024-09-12T02:34:53.919349+0000","last_peered":"2024-09-12T02:34:53.919349+0000","last_clean":"2024-09-12T02:34:53.919349+0000","last_became_active":"2024-09-12T02:34:53.916543+0000","last_became_peered":"2024-09-12T02:34:53.916543+0000","last_unstale":"2024-09-12T02:34:53.919349+0000","last_undegraded":"2024-09-12T02:34:53.919349+0000","last_fullsized":"2024-09-12T02:34:53.919349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908630+0000","last_change":"2024-09-12T02:34:52.896981+0000","last_active":"2024-09-12T02:34:53.908630+0000","last_peered":"2024-09-12T02:34:53.908630+0000","last_clean":"2024-09-12T02:34:53.908630+0000","last_became_active":"2024-09-12T02:34:52.896728+0000","last_became_peered":"2024-09-12T02:34:52.896728+0000","last_unstale":"2024-09-12T02:34:53.908630+0000","last_undegraded":"2024-09-12T02:34:53.908630+0000","last_fullsized":"2024-09-12T02:34:53.908630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:51.190888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922569+0000","last_change":"2024-09-12T02:34:53.917338+0000","last_active":"2024-09-12T02:34:53.922569+0000","last_peered":"2024-09-12T02:34:53.922569+0000","last_clean":"2024-09-12T02:34:53.922569+0000","last_became_active":"2024-09-12T02:34:53.917083+0000","last_became_peered":"2024-09-12T02:34:53.917083+0000","last_unstale":"2024-09-12T02:34:53.922569+0000","last_undegraded":"2024-09-12T02:34:53.922569+0000","last_fullsized":"2024-09-12T02:34:53.922569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.903380+0000","last_change":"2024-09-12T02:34:52.899652+0000","last_active":"2024-09-12T02:34:53.903380+0000","last_peered":"2024-09-12T02:34:53.903380+0000","last_clean":"2024-09-12T02:34:53.903380+0000","last_became_active":"2024-09-12T02:34:52.899400+0000","last_became_peered":"2024-09-12T02:34:52.899400+0000","last_unstale":"2024-09-12T02:34:53.903380+0000","last_undegraded":"2024-09-12T02:34:53.903380+0000","last_fullsized":"2024-09-12T02:34:53.903380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.376482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917485+0000","last_change":"2024-09-12T02:34:53.915187+0000","last_active":"2024-09-12T02:34:54.917485+0000","last_peered":"2024-09-12T02:34:54.917485+0000","last_clean":"2024-09-12T02:34:54.917485+0000","last_became_active":"2024-09-12T02:34:53.914912+0000","last_became_peered":"2024-09-12T02:34:53.914912+0000","last_unstale":"2024-09-12T02:34:54.917485+0000","last_undegraded":"2024-09-12T02:34:54.917485+0000","last_fullsized":"2024-09-12T02:34:54.917485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916676+0000","last_change":"2024-09-12T02:34:52.901417+0000","last_active":"2024-09-12T02:34:54.916676+0000","last_peered":"2024-09-12T02:34:54.916676+0000","last_clean":"2024-09-12T02:34:54.916676+0000","last_became_active":"2024-09-12T02:34:52.901140+0000","last_became_peered":"2024-09-12T02:34:52.901140+0000","last_unstale":"2024-09-12T02:34:54.916676+0000","last_undegraded":"2024-09-12T02:34:54.916676+0000","last_fullsized":"2024-09-12T02:34:54.916676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.918367+0000","last_change":"2024-09-12T02:34:53.917211+0000","last_active":"2024-09-12T02:34:53.918367+0000","last_peered":"2024-09-12T02:34:53.918367+0000","last_clean":"2024-09-12T02:34:53.918367+0000","last_became_active":"2024-09-12T02:34:53.916853+0000","last_became_peered":"2024-09-12T02:34:53.916853+0000","last_unstale":"2024-09-12T02:34:53.918367+0000","last_undegraded":"2024-09-12T02:34:53.918367+0000","last_fullsized":"2024-09-12T02:34:53.918367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.030651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.902019+0000","last_change":"2024-09-12T02:34:52.899954+0000","last_active":"2024-09-12T02:34:52.902019+0000","last_peered":"2024-09-12T02:34:52.902019+0000","last_clean":"2024-09-12T02:34:52.902019+0000","last_became_active":"2024-09-12T02:34:52.899233+0000","last_became_peered":"2024-09-12T02:34:52.899233+0000","last_unstale":"2024-09-12T02:34:52.902019+0000","last_undegraded":"2024-09-12T02:34:52.902019+0000","last_fullsized":"2024-09-12T02:34:52.902019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:03.154855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923987+0000","last_change":"2024-09-12T02:34:53.931173+0000","last_active":"2024-09-12T02:34:54.923987+0000","last_peered":"2024-09-12T02:34:54.923987+0000","last_clean":"2024-09-12T02:34:54.923987+0000","last_became_active":"2024-09-12T02:34:53.930915+0000","last_became_peered":"2024-09-12T02:34:53.930915+0000","last_unstale":"2024-09-12T02:34:54.923987+0000","last_undegraded":"2024-09-12T02:34:54.923987+0000","last_fullsized":"2024-09-12T02:34:54.923987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:47.854136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908942+0000","last_change":"2024-09-12T02:34:52.899556+0000","last_active":"2024-09-12T02:34:53.908942+0000","last_peered":"2024-09-12T02:34:53.908942+0000","last_clean":"2024-09-12T02:34:53.908942+0000","last_became_active":"2024-09-12T02:34:52.899205+0000","last_became_peered":"2024-09-12T02:34:52.899205+0000","last_unstale":"2024-09-12T02:34:53.908942+0000","last_undegraded":"2024-09-12T02:34:53.908942+0000","last_fullsized":"2024-09-12T02:34:53.908942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.906853+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:53.906853+0000","last_peered":"2024-09-12T02:34:53.906853+0000","last_clean":"2024-09-12T02:34:53.906853+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:53.906853+0000","last_undegraded":"2024-09-12T02:34:53.906853+0000","last_fullsized":"2024-09-12T02:34:53.906853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":781535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476754,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":196781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":425984,"data_stored":182318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":772686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.894314+0000', 'last_change': '2024-09-12T02:34:52.894314+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.894314+0000', 'last_undegraded': '2024-09-12T02:34:52.894314+0000', 'last_fullsized': '2024-09-12T02:34:52.894314+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.892289+0000', 'last_change': '2024-09-12T02:34:52.892289+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.892289+0000', 'last_undegraded': '2024-09-12T02:34:52.892289+0000', 'last_fullsized': '2024-09-12T02:34:52.892289+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-12T02:34:57.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.893487+0000', 'last_change': '2024-09-12T02:34:52.893487+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.893487+0000', 'last_undegraded': '2024-09-12T02:34:52.893487+0000', 'last_fullsized': '2024-09-12T02:34:52.893487+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.894660+0000', 'last_change': '2024-09-12T02:34:52.894660+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.894660+0000', 'last_undegraded': '2024-09-12T02:34:52.894660+0000', 'last_fullsized': '2024-09-12T02:34:52.894660+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.633 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.895781+0000', 'last_change': '2024-09-12T02:34:52.895781+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.895781+0000', 'last_undegraded': '2024-09-12T02:34:52.895781+0000', 'last_fullsized': '2024-09-12T02:34:52.895781+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.892700+0000', 'last_change': '2024-09-12T02:34:52.892700+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.892700+0000', 'last_undegraded': '2024-09-12T02:34:52.892700+0000', 'last_fullsized': '2024-09-12T02:34:52.892700+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.895448+0000', 'last_change': '2024-09-12T02:34:52.895448+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.895448+0000', 'last_undegraded': '2024-09-12T02:34:52.895448+0000', 'last_fullsized': '2024-09-12T02:34:52.895448+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.892914+0000', 'last_change': '2024-09-12T02:34:52.892914+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.892914+0000', 'last_undegraded': '2024-09-12T02:34:52.892914+0000', 'last_fullsized': '2024-09-12T02:34:52.892914+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-12T02:34:57.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:51.888257+0000', 'last_change': '2024-09-12T02:34:51.888257+0000', 'last_active': '2024-09-12T02:34:51.878505+0000', 'last_peered': '2024-09-12T02:34:51.878505+0000', 'last_clean': '2024-09-12T02:34:51.878505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:51.888257+0000', 'last_undegraded': '2024-09-12T02:34:51.888257+0000', 'last_fullsized': '2024-09-12T02:34:51.888257+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:34:52.883066+0000', 'last_change': '2024-09-12T02:34:52.883066+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.883066+0000', 'last_undegraded': '2024-09-12T02:34:52.883066+0000', 'last_fullsized': '2024-09-12T02:34:52.883066+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:51.888252+0000', 'last_change': '2024-09-12T02:34:51.888252+0000', 'last_active': '2024-09-12T02:34:51.878505+0000', 'last_peered': '2024-09-12T02:34:51.878505+0000', 'last_clean': '2024-09-12T02:34:51.878505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:51.888252+0000', 'last_undegraded': '2024-09-12T02:34:51.888252+0000', 'last_fullsized': '2024-09-12T02:34:51.888252+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:51.888239+0000', 'last_change': '2024-09-12T02:34:51.888239+0000', 'last_active': '2024-09-12T02:34:51.878505+0000', 'last_peered': '2024-09-12T02:34:51.878505+0000', 'last_clean': '2024-09-12T02:34:51.878505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:51.888239+0000', 'last_undegraded': '2024-09-12T02:34:51.888239+0000', 'last_fullsized': '2024-09-12T02:34:51.888239+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.895096+0000', 'last_change': '2024-09-12T02:34:52.895096+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.895096+0000', 'last_undegraded': '2024-09-12T02:34:52.895096+0000', 'last_fullsized': '2024-09-12T02:34:52.895096+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:51.888007+0000', 'last_change': '2024-09-12T02:34:51.888007+0000', 'last_active': '2024-09-12T02:34:51.878505+0000', 'last_peered': '2024-09-12T02:34:51.878505+0000', 'last_clean': '2024-09-12T02:34:51.878505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:51.888007+0000', 'last_undegraded': '2024-09-12T02:34:51.888007+0000', 'last_fullsized': '2024-09-12T02:34:51.888007+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:34:57.635 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-12T02:34:57.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:51.887613+0000', 'last_change': '2024-09-12T02:34:51.887613+0000', 'last_active': '2024-09-12T02:34:51.878505+0000', 'last_peered': '2024-09-12T02:34:51.878505+0000', 'last_clean': '2024-09-12T02:34:51.878505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:51.887613+0000', 'last_undegraded': '2024-09-12T02:34:51.887613+0000', 'last_fullsized': '2024-09-12T02:34:51.887613+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:51.878505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:34:57.636 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-12T02:34:57.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:34:52.891836+0000', 'last_change': '2024-09-12T02:34:52.891836+0000', 'last_active': '2024-09-12T02:34:52.883066+0000', 'last_peered': '2024-09-12T02:34:52.883066+0000', 'last_clean': '2024-09-12T02:34:52.883066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:34:52.891836+0000', 'last_undegraded': '2024-09-12T02:34:52.891836+0000', 'last_fullsized': '2024-09-12T02:34:52.891836+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'last_clean_scrub_stamp': '2024-09-12T02:34:52.883066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:34:57.636 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:34:57.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.782+0000 7fc846a1e640 1 Processor -- start 2024-09-12T02:34:57.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.782+0000 7fc846a1e640 1 -- start start 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc846a1e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc8400af560 0x7fc8401691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc846a1e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84006cb30 con 0x7fc840147360 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc846a1e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84006bfb0 con 0x7fc8400d04a0 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc846a1e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc84006c290 con 0x7fc8400af560 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc844fbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc8400af560 0x7fc8401691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc83ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc840147360 0x7fc840070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:48306/0 (socket says 172.21.15.119:48306) 2024-09-12T02:34:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc83ffff640 1 -- 172.21.15.119:0/3490810120 learned_addr learned my addr 172.21.15.119:0/3490810120 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:57.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc844fbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc8400af560 0x7fc8401691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46988/0 (socket says 172.21.15.119:46988) 2024-09-12T02:34:57.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc844fbb640 1 -- 172.21.15.119:0/3490810120 >> v1:172.21.15.153:6789/0 conn(0x7fc8400d04a0 legacy=0x7fc8400d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:57.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc844fbb640 1 -- 172.21.15.119:0/3490810120 >> v1:172.21.15.119:6789/0 conn(0x7fc840147360 legacy=0x7fc840070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.784+0000 7fc844fbb640 1 -- 172.21.15.119:0/3490810120 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84006c570 con 0x7fc8400af560 2024-09-12T02:34:57.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.783+0000 7fc83effd640 1 -- 172.21.15.119:0/3490810120 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902913632 0 0) 0x7fc84006cb30 con 0x7fc840147360 2024-09-12T02:34:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.784+0000 7fc844fbb640 1 --2- 172.21.15.119:0/3490810120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400af560 0x7fc8401691e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc83802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2982b0976025402c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.784+0000 7fc83effd640 1 -- 172.21.15.119:0/3490810120 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838031600 con 0x7fc8400af560 2024-09-12T02:34:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.784+0000 7fc83effd640 1 -- 172.21.15.119:0/3490810120 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380317a0 con 0x7fc8400af560 2024-09-12T02:34:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.784+0000 7fc83effd640 1 -- 172.21.15.119:0/3490810120 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838031b70 con 0x7fc8400af560 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 -- 172.21.15.119:0/3490810120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400af560 msgr2=0x7fc8401691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 --2- 172.21.15.119:0/3490810120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400af560 0x7fc8401691e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc83802a610 comp rx=0 tx=0).stop 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 -- 172.21.15.119:0/3490810120 shutdown_connections 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 --2- 172.21.15.119:0/3490810120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400af560 0x7fc8401691e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 -- 172.21.15.119:0/3490810120 >> 172.21.15.119:0/3490810120 conn(0x7fc8400b2f40 msgr2=0x7fc8400b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 -- 172.21.15.119:0/3490810120 shutdown_connections 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.785+0000 7fc846a1e640 1 -- 172.21.15.119:0/3490810120 wait complete. 2024-09-12T02:34:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.786+0000 7fc846a1e640 1 Processor -- start 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.786+0000 7fc846a1e640 1 -- start start 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8400af560 0x7fc8400b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 0x7fc84015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc84006bc10 con 0x7fc8400d04a0 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc840070fa0 con 0x7fc840147360 2024-09-12T02:34:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc846a1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc84006bd90 con 0x7fc8400af560 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46998/0 (socket says 172.21.15.119:46998) 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 -- 172.21.15.119:0/4233408315 learned_addr learned my addr 172.21.15.119:0/4233408315 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83ffff640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8400af560 0x7fc8400b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc844fbb640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 0x7fc84015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 -- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8400af560 msgr2=0x7fc8400b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8400af560 0x7fc8400b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 -- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 msgr2=0x7fc84015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 0x7fc84015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc83f7fe640 1 -- 172.21.15.119:0/4233408315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc840142130 con 0x7fc8400d04a0 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.787+0000 7fc844fbb640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 0x7fc84015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc83f7fe640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c430 tx=0x7fc83400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834011790 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834017070 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834011bb0 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8400b68b0 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.788+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8401596e0 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.789+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8400d0910 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.789+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc83401c460 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.790+0000 7fc83cff9640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 0x7fc82c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.790+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc83408ada0 con 0x7fc8400d04a0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.790+0000 7fc83ffff640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 0x7fc82c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.790+0000 7fc83ffff640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 0x7fc82c06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc830007fd0 tx=0x7fc830007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:57.794+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8340595c0 con 0x7fc8400d04a0 2024-09-12T02:34:58.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.023+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc840146b60 con 0x7fc8400d04a0 2024-09-12T02:34:58.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.023+0000 7fc83cff9640 1 -- 172.21.15.119:0/4233408315 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1763 (secure 0 0 0) 0x7fc834058ec0 con 0x7fc8400d04a0 2024-09-12T02:34:58.024 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:58.024 INFO:teuthology.orchestra.run.smithi119.stdout:{"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108429,"num_in_osds":8,"osd_in_since":1726108419,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"creating+peering","count":15},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":591062,"bytes_used":226103296,"bytes_avail":772868009984,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":578,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4851}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T02:34:51.190220+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 msgr2=0x7fc82c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 0x7fc82c06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc830007fd0 tx=0x7fc830007de0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 msgr2=0x7fc840138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c430 tx=0x7fc83400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 shutdown_connections 2024-09-12T02:34:58.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc82c06be30 0x7fc82c06e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840147360 0x7fc84015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8400d04a0 0x7fc840138a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 --2- 172.21.15.119:0/4233408315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8400af560 0x7fc8400b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 >> 172.21.15.119:0/4233408315 conn(0x7fc8400b2f40 msgr2=0x7fc84006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 shutdown_connections 2024-09-12T02:34:58.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.025+0000 7fc846a1e640 1 -- 172.21.15.119:0/4233408315 wait complete. 2024-09-12T02:34:58.037 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:34:58.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:34:58.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.135+0000 7f00fed42640 1 Processor -- start 2024-09-12T02:34:58.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.135+0000 7f00fed42640 1 -- start start 2024-09-12T02:34:58.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fed42640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00f80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fed42640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00f80ae550 0x7f00f80ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fed42640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f806cb30 con 0x7f00f8147360 2024-09-12T02:34:58.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fed42640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f00f806bfb0 con 0x7f00f80ae550 2024-09-12T02:34:58.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fed42640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00f806c290 con 0x7f00f80d04a0 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fcade640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f00f8147360 0x7f00f8070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40598/0 (socket says 172.21.15.119:40598) 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fcade640 1 -- 172.21.15.119:0/2077586039 learned_addr learned my addr 172.21.15.119:0/2077586039 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983174490 0 0) 0x7f00f806cb30 con 0x7f00f8147360 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e8003520 con 0x7f00f8147360 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00f7fff640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00f80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00fd2df640 1 --2- 172.21.15.119:0/2077586039 >> v2:172.21.15.153:3300/0 conn(0x7f00f80ae550 0x7f00f80ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3462952080 0 0) 0x7f00e8003520 con 0x7f00f8147360 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.136+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 msgr2=0x7f00f80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00f80d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 >> v2:172.21.15.153:3300/0 conn(0x7f00f80ae550 msgr2=0x7f00f80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 --2- 172.21.15.119:0/2077586039 >> v2:172.21.15.153:3300/0 conn(0x7f00f80ae550 0x7f00f80ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f806c570 con 0x7f00f8147360 2024-09-12T02:34:58.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f00ec001670 con 0x7f00f8147360 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 >> v1:172.21.15.119:6789/0 conn(0x7f00f8147360 legacy=0x7f00f8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00e80039b0 0x7f00e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00f806bfb0 con 0x7f00e8004800 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00f806c290 con 0x7f00e80039b0 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00e800b9c0 con 0x7f00f80d04a0 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00fcade640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00e80039b0 0x7f00e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00fd2df640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 -- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 msgr2=0x7f00e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 -- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00e80039b0 msgr2=0x7f00e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:58.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00e80039b0 0x7f00e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00f7fff640 1 -- 172.21.15.119:0/2077586039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e8003520 con 0x7f00e8004800 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.137+0000 7f00fd2df640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f80d04a0 0x7f00e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00f7fff640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00e8004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009af0 tx=0x7f00e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527bed3cc23a25d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4036070 con 0x7f00e8004800 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e4031400 con 0x7f00e8004800 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00f77fe640 1 -- 172.21.15.119:0/2077586039 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4009690 con 0x7f00e8004800 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 -- 172.21.15.119:0/2077586039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 msgr2=0x7f00e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 --2- 172.21.15.119:0/2077586039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00e8004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009af0 tx=0x7f00e8005830 comp rx=0 tx=0).stop 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fd2df640 1 -- 172.21.15.119:0/2077586039 reap_dead start 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 -- 172.21.15.119:0/2077586039 shutdown_connections 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 -- 172.21.15.119:0/2077586039 >> 172.21.15.119:0/2077586039 conn(0x7f00f80b2f40 msgr2=0x7f00f80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 -- 172.21.15.119:0/2077586039 shutdown_connections 2024-09-12T02:34:58.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.138+0000 7f00fed42640 1 -- 172.21.15.119:0/2077586039 wait complete. 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 Processor -- start 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 -- start start 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f813cf70 0x7f00f81f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f813d3f0 0x7f00f81f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00f806bc10 con 0x7f00e8004800 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00f8070fa0 con 0x7f00f813cf70 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.140+0000 7f00fed42640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00f806bd90 con 0x7f00f813d3f0 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42942/0 (socket says 172.21.15.119:42942) 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 -- 172.21.15.119:0/112566882 learned_addr learned my addr 172.21.15.119:0/112566882 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00f7fff640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f813cf70 0x7f00f81f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fd2df640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f813d3f0 0x7f00f81f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 -- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f813d3f0 msgr2=0x7f00f81f4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f813d3f0 0x7f00f81f4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 -- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f813cf70 msgr2=0x7f00f81f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f813cf70 0x7f00f81f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 -- 172.21.15.119:0/112566882 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f813c110 con 0x7f00e8004800 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fcade640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00ec007370 tx=0x7f00ec007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00f9c0 con 0x7f00e8004800 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ec018070 con 0x7f00e8004800 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f81f4880 con 0x7f00e8004800 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00fda0 con 0x7f00e8004800 2024-09-12T02:34:58.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.141+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f813b3d0 con 0x7f00e8004800 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.142+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f8070890 con 0x7f00e8004800 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.143+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00ec01d460 con 0x7f00e8004800 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.143+0000 7f00f57fa640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 0x7f00dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.143+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f00ec08aff0 con 0x7f00e8004800 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.143+0000 7f00f7fff640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 0x7f00dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:58.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.144+0000 7f00f7fff640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 0x7f00dc06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f00e4033000 tx=0x7f00e4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:58.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.147+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00ec0591c0 con 0x7f00e8004800 2024-09-12T02:34:58.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.310+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00f8161c50 con 0x7f00dc06be30 2024-09-12T02:34:58.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.316+0000 7f00f57fa640 1 -- 172.21.15.119:0/112566882 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7f00f8161c50 con 0x7f00dc06be30 2024-09-12T02:34:58.319 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:34:58.320 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 msgr2=0x7f00dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 0x7f00dc06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f00e4033000 tx=0x7f00e4008030 comp rx=0 tx=0).stop 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 msgr2=0x7f00f813bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00ec007370 tx=0x7f00ec007830 comp rx=0 tx=0).stop 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 shutdown_connections 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f00dc06be30 0x7f00dc06e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f813d3f0 0x7f00f81f4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f813cf70 0x7f00f81f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 --2- 172.21.15.119:0/112566882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00e8004800 0x7f00f813bbd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:58.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 >> 172.21.15.119:0/112566882 conn(0x7f00f80b2f40 msgr2=0x7f00f80afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:58.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 shutdown_connections 2024-09-12T02:34:58.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:34:58.319+0000 7f00fed42640 1 -- 172.21.15.119:0/112566882 wait complete. 2024-09-12T02:34:58.331 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T02:34:57.191020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220804,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753916,"statfs":{"total":773094113280,"available":772868009984,"internally_reserved":0,"allocated":4669440,"data_stored":2664286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.307387"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894314+0000","last_change":"2024-09-12T02:34:52.894314+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894314+0000","last_undegraded":"2024-09-12T02:34:52.894314+0000","last_fullsized":"2024-09-12T02:34:52.894314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892289+0000","last_change":"2024-09-12T02:34:52.892289+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892289+0000","last_undegraded":"2024-09-12T02:34:52.892289+0000","last_fullsized":"2024-09-12T02:34:52.892289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.927110+0000","last_change":"2024-09-12T02:34:53.925071+0000","last_active":"2024-09-12T02:34:53.927110+0000","last_peered":"2024-09-12T02:34:53.927110+0000","last_clean":"2024-09-12T02:34:53.927110+0000","last_became_active":"2024-09-12T02:34:53.924546+0000","last_became_peered":"2024-09-12T02:34:53.924546+0000","last_unstale":"2024-09-12T02:34:53.927110+0000","last_undegraded":"2024-09-12T02:34:53.927110+0000","last_fullsized":"2024-09-12T02:34:53.927110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928050+0000","last_change":"2024-09-12T02:34:53.926491+0000","last_active":"2024-09-12T02:34:53.928050+0000","last_peered":"2024-09-12T02:34:53.928050+0000","last_clean":"2024-09-12T02:34:53.928050+0000","last_became_active":"2024-09-12T02:34:53.926211+0000","last_became_peered":"2024-09-12T02:34:53.926211+0000","last_unstale":"2024-09-12T02:34:53.928050+0000","last_undegraded":"2024-09-12T02:34:53.928050+0000","last_fullsized":"2024-09-12T02:34:53.928050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923494+0000","last_change":"2024-09-12T02:34:53.931710+0000","last_active":"2024-09-12T02:34:54.923494+0000","last_peered":"2024-09-12T02:34:54.923494+0000","last_clean":"2024-09-12T02:34:54.923494+0000","last_became_active":"2024-09-12T02:34:53.931441+0000","last_became_peered":"2024-09-12T02:34:53.931441+0000","last_unstale":"2024-09-12T02:34:54.923494+0000","last_undegraded":"2024-09-12T02:34:54.923494+0000","last_fullsized":"2024-09-12T02:34:54.923494+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:15.773861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.893487+0000","last_change":"2024-09-12T02:34:52.893487+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.893487+0000","last_undegraded":"2024-09-12T02:34:52.893487+0000","last_fullsized":"2024-09-12T02:34:52.893487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926607+0000","last_change":"2024-09-12T02:34:53.922929+0000","last_active":"2024-09-12T02:34:53.926607+0000","last_peered":"2024-09-12T02:34:53.926607+0000","last_clean":"2024-09-12T02:34:53.926607+0000","last_became_active":"2024-09-12T02:34:53.922520+0000","last_became_peered":"2024-09-12T02:34:53.922520+0000","last_unstale":"2024-09-12T02:34:53.926607+0000","last_undegraded":"2024-09-12T02:34:53.926607+0000","last_fullsized":"2024-09-12T02:34:53.926607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923946+0000","last_change":"2024-09-12T02:34:53.928906+0000","last_active":"2024-09-12T02:34:54.923946+0000","last_peered":"2024-09-12T02:34:54.923946+0000","last_clean":"2024-09-12T02:34:54.923946+0000","last_became_active":"2024-09-12T02:34:53.928621+0000","last_became_peered":"2024-09-12T02:34:53.928621+0000","last_unstale":"2024-09-12T02:34:54.923946+0000","last_undegraded":"2024-09-12T02:34:54.923946+0000","last_fullsized":"2024-09-12T02:34:54.923946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:47.050346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923907+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923907+0000","last_peered":"2024-09-12T02:34:54.923907+0000","last_clean":"2024-09-12T02:34:54.923907+0000","last_became_active":"2024-09-12T02:34:53.924943+0000","last_became_peered":"2024-09-12T02:34:53.924943+0000","last_unstale":"2024-09-12T02:34:54.923907+0000","last_undegraded":"2024-09-12T02:34:54.923907+0000","last_fullsized":"2024-09-12T02:34:54.923907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:59.114212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922349+0000","last_change":"2024-09-12T02:34:53.916964+0000","last_active":"2024-09-12T02:34:53.922349+0000","last_peered":"2024-09-12T02:34:53.922349+0000","last_clean":"2024-09-12T02:34:53.922349+0000","last_became_active":"2024-09-12T02:34:53.916680+0000","last_became_peered":"2024-09-12T02:34:53.916680+0000","last_unstale":"2024-09-12T02:34:53.922349+0000","last_undegraded":"2024-09-12T02:34:53.922349+0000","last_fullsized":"2024-09-12T02:34:53.922349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923582+0000","last_change":"2024-09-12T02:34:53.929140+0000","last_active":"2024-09-12T02:34:54.923582+0000","last_peered":"2024-09-12T02:34:54.923582+0000","last_clean":"2024-09-12T02:34:54.923582+0000","last_became_active":"2024-09-12T02:34:53.928842+0000","last_became_peered":"2024-09-12T02:34:53.928842+0000","last_unstale":"2024-09-12T02:34:54.923582+0000","last_undegraded":"2024-09-12T02:34:54.923582+0000","last_fullsized":"2024-09-12T02:34:54.923582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.169910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917126+0000","last_change":"2024-09-12T02:34:53.906988+0000","last_active":"2024-09-12T02:34:54.917126+0000","last_peered":"2024-09-12T02:34:54.917126+0000","last_clean":"2024-09-12T02:34:54.917126+0000","last_became_active":"2024-09-12T02:34:53.906697+0000","last_became_peered":"2024-09-12T02:34:53.906697+0000","last_unstale":"2024-09-12T02:34:54.917126+0000","last_undegraded":"2024-09-12T02:34:54.917126+0000","last_fullsized":"2024-09-12T02:34:54.917126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923527+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923527+0000","last_peered":"2024-09-12T02:34:54.923527+0000","last_clean":"2024-09-12T02:34:54.923527+0000","last_became_active":"2024-09-12T02:34:53.925046+0000","last_became_peered":"2024-09-12T02:34:53.925046+0000","last_unstale":"2024-09-12T02:34:54.923527+0000","last_undegraded":"2024-09-12T02:34:54.923527+0000","last_fullsized":"2024-09-12T02:34:54.923527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:30.672733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.924778+0000","last_change":"2024-09-12T02:34:53.922618+0000","last_active":"2024-09-12T02:34:53.924778+0000","last_peered":"2024-09-12T02:34:53.924778+0000","last_clean":"2024-09-12T02:34:53.924778+0000","last_became_active":"2024-09-12T02:34:53.922054+0000","last_became_peered":"2024-09-12T02:34:53.922054+0000","last_unstale":"2024-09-12T02:34:53.924778+0000","last_undegraded":"2024-09-12T02:34:53.924778+0000","last_fullsized":"2024-09-12T02:34:53.924778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:20.945914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.924710+0000","last_change":"2024-09-12T02:34:53.923038+0000","last_active":"2024-09-12T02:34:53.924710+0000","last_peered":"2024-09-12T02:34:53.924710+0000","last_clean":"2024-09-12T02:34:53.924710+0000","last_became_active":"2024-09-12T02:34:53.922649+0000","last_became_peered":"2024-09-12T02:34:53.922649+0000","last_unstale":"2024-09-12T02:34:53.924710+0000","last_undegraded":"2024-09-12T02:34:53.924710+0000","last_fullsized":"2024-09-12T02:34:53.924710+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914563+0000","last_change":"2024-09-12T02:34:53.907701+0000","last_active":"2024-09-12T02:34:53.914563+0000","last_peered":"2024-09-12T02:34:53.914563+0000","last_clean":"2024-09-12T02:34:53.914563+0000","last_became_active":"2024-09-12T02:34:53.907425+0000","last_became_peered":"2024-09-12T02:34:53.907425+0000","last_unstale":"2024-09-12T02:34:53.914563+0000","last_undegraded":"2024-09-12T02:34:53.914563+0000","last_fullsized":"2024-09-12T02:34:53.914563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:21.915931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.914760+0000","last_change":"2024-09-12T02:34:53.908746+0000","last_active":"2024-09-12T02:34:53.914760+0000","last_peered":"2024-09-12T02:34:53.914760+0000","last_clean":"2024-09-12T02:34:53.914760+0000","last_became_active":"2024-09-12T02:34:53.908484+0000","last_became_peered":"2024-09-12T02:34:53.908484+0000","last_unstale":"2024-09-12T02:34:53.914760+0000","last_undegraded":"2024-09-12T02:34:53.914760+0000","last_fullsized":"2024-09-12T02:34:53.914760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:03.587388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923665+0000","last_change":"2024-09-12T02:34:53.926067+0000","last_active":"2024-09-12T02:34:54.923665+0000","last_peered":"2024-09-12T02:34:54.923665+0000","last_clean":"2024-09-12T02:34:54.923665+0000","last_became_active":"2024-09-12T02:34:53.925776+0000","last_became_peered":"2024-09-12T02:34:53.925776+0000","last_unstale":"2024-09-12T02:34:54.923665+0000","last_undegraded":"2024-09-12T02:34:54.923665+0000","last_fullsized":"2024-09-12T02:34:54.923665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:41.377035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917344+0000","last_change":"2024-09-12T02:34:53.919856+0000","last_active":"2024-09-12T02:34:54.917344+0000","last_peered":"2024-09-12T02:34:54.917344+0000","last_clean":"2024-09-12T02:34:54.917344+0000","last_became_active":"2024-09-12T02:34:53.918841+0000","last_became_peered":"2024-09-12T02:34:53.918841+0000","last_unstale":"2024-09-12T02:34:54.917344+0000","last_undegraded":"2024-09-12T02:34:54.917344+0000","last_fullsized":"2024-09-12T02:34:54.917344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923208+0000","last_change":"2024-09-12T02:34:53.921158+0000","last_active":"2024-09-12T02:34:53.923208+0000","last_peered":"2024-09-12T02:34:53.923208+0000","last_clean":"2024-09-12T02:34:53.923208+0000","last_became_active":"2024-09-12T02:34:53.920889+0000","last_became_peered":"2024-09-12T02:34:53.920889+0000","last_unstale":"2024-09-12T02:34:53.923208+0000","last_undegraded":"2024-09-12T02:34:53.923208+0000","last_fullsized":"2024-09-12T02:34:53.923208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923956+0000","last_change":"2024-09-12T02:34:53.920936+0000","last_active":"2024-09-12T02:34:53.923956+0000","last_peered":"2024-09-12T02:34:53.923956+0000","last_clean":"2024-09-12T02:34:53.923956+0000","last_became_active":"2024-09-12T02:34:53.920663+0000","last_became_peered":"2024-09-12T02:34:53.920663+0000","last_unstale":"2024-09-12T02:34:53.923956+0000","last_undegraded":"2024-09-12T02:34:53.923956+0000","last_fullsized":"2024-09-12T02:34:53.923956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:39.371309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933174+0000","last_change":"2024-09-12T02:34:53.931129+0000","last_active":"2024-09-12T02:34:53.933174+0000","last_peered":"2024-09-12T02:34:53.933174+0000","last_clean":"2024-09-12T02:34:53.933174+0000","last_became_active":"2024-09-12T02:34:53.930795+0000","last_became_peered":"2024-09-12T02:34:53.930795+0000","last_unstale":"2024-09-12T02:34:53.933174+0000","last_undegraded":"2024-09-12T02:34:53.933174+0000","last_fullsized":"2024-09-12T02:34:53.933174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922936+0000","last_change":"2024-09-12T02:34:53.919417+0000","last_active":"2024-09-12T02:34:53.922936+0000","last_peered":"2024-09-12T02:34:53.922936+0000","last_clean":"2024-09-12T02:34:53.922936+0000","last_became_active":"2024-09-12T02:34:53.919134+0000","last_became_peered":"2024-09-12T02:34:53.919134+0000","last_unstale":"2024-09-12T02:34:53.922936+0000","last_undegraded":"2024-09-12T02:34:53.922936+0000","last_fullsized":"2024-09-12T02:34:53.922936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:00.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923830+0000","last_change":"2024-09-12T02:34:53.932447+0000","last_active":"2024-09-12T02:34:54.923830+0000","last_peered":"2024-09-12T02:34:54.923830+0000","last_clean":"2024-09-12T02:34:54.923830+0000","last_became_active":"2024-09-12T02:34:53.931915+0000","last_became_peered":"2024-09-12T02:34:53.931915+0000","last_unstale":"2024-09-12T02:34:54.923830+0000","last_undegraded":"2024-09-12T02:34:54.923830+0000","last_fullsized":"2024-09-12T02:34:54.923830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:52.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.923263+0000","last_change":"2024-09-12T02:34:53.919705+0000","last_active":"2024-09-12T02:34:53.923263+0000","last_peered":"2024-09-12T02:34:53.923263+0000","last_clean":"2024-09-12T02:34:53.923263+0000","last_became_active":"2024-09-12T02:34:53.919433+0000","last_became_peered":"2024-09-12T02:34:53.919433+0000","last_unstale":"2024-09-12T02:34:53.923263+0000","last_undegraded":"2024-09-12T02:34:53.923263+0000","last_fullsized":"2024-09-12T02:34:53.923263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:10.620223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921150+0000","last_change":"2024-09-12T02:34:53.914329+0000","last_active":"2024-09-12T02:34:53.921150+0000","last_peered":"2024-09-12T02:34:53.921150+0000","last_clean":"2024-09-12T02:34:53.921150+0000","last_became_active":"2024-09-12T02:34:53.914049+0000","last_became_peered":"2024-09-12T02:34:53.914049+0000","last_unstale":"2024-09-12T02:34:53.921150+0000","last_undegraded":"2024-09-12T02:34:53.921150+0000","last_fullsized":"2024-09-12T02:34:53.921150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.975603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921695+0000","last_change":"2024-09-12T02:34:53.919485+0000","last_active":"2024-09-12T02:34:53.921695+0000","last_peered":"2024-09-12T02:34:53.921695+0000","last_clean":"2024-09-12T02:34:53.921695+0000","last_became_active":"2024-09-12T02:34:53.919198+0000","last_became_peered":"2024-09-12T02:34:53.919198+0000","last_unstale":"2024-09-12T02:34:53.921695+0000","last_undegraded":"2024-09-12T02:34:53.921695+0000","last_fullsized":"2024-09-12T02:34:53.921695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922663+0000","last_change":"2024-09-12T02:34:53.918077+0000","last_active":"2024-09-12T02:34:53.922663+0000","last_peered":"2024-09-12T02:34:53.922663+0000","last_clean":"2024-09-12T02:34:53.922663+0000","last_became_active":"2024-09-12T02:34:53.917730+0000","last_became_peered":"2024-09-12T02:34:53.917730+0000","last_unstale":"2024-09-12T02:34:53.922663+0000","last_undegraded":"2024-09-12T02:34:53.922663+0000","last_fullsized":"2024-09-12T02:34:53.922663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933513+0000","last_change":"2024-09-12T02:34:53.931065+0000","last_active":"2024-09-12T02:34:53.933513+0000","last_peered":"2024-09-12T02:34:53.933513+0000","last_clean":"2024-09-12T02:34:53.933513+0000","last_became_active":"2024-09-12T02:34:53.930797+0000","last_became_peered":"2024-09-12T02:34:53.930797+0000","last_unstale":"2024-09-12T02:34:53.933513+0000","last_undegraded":"2024-09-12T02:34:53.933513+0000","last_fullsized":"2024-09-12T02:34:53.933513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936684+0000","last_change":"2024-09-12T02:34:52.905869+0000","last_active":"2024-09-12T02:34:53.936684+0000","last_peered":"2024-09-12T02:34:53.936684+0000","last_clean":"2024-09-12T02:34:53.936684+0000","last_became_active":"2024-09-12T02:34:52.905438+0000","last_became_peered":"2024-09-12T02:34:52.905438+0000","last_unstale":"2024-09-12T02:34:53.936684+0000","last_undegraded":"2024-09-12T02:34:53.936684+0000","last_fullsized":"2024-09-12T02:34:53.936684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:37.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.928019+0000","last_change":"2024-09-12T02:34:53.925843+0000","last_active":"2024-09-12T02:34:53.928019+0000","last_peered":"2024-09-12T02:34:53.928019+0000","last_clean":"2024-09-12T02:34:53.928019+0000","last_became_active":"2024-09-12T02:34:53.925579+0000","last_became_peered":"2024-09-12T02:34:53.925579+0000","last_unstale":"2024-09-12T02:34:53.928019+0000","last_undegraded":"2024-09-12T02:34:53.928019+0000","last_fullsized":"2024-09-12T02:34:53.928019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926540+0000","last_change":"2024-09-12T02:34:52.897888+0000","last_active":"2024-09-12T02:34:53.926540+0000","last_peered":"2024-09-12T02:34:53.926540+0000","last_clean":"2024-09-12T02:34:53.926540+0000","last_became_active":"2024-09-12T02:34:52.897621+0000","last_became_peered":"2024-09-12T02:34:52.897621+0000","last_unstale":"2024-09-12T02:34:53.926540+0000","last_undegraded":"2024-09-12T02:34:53.926540+0000","last_fullsized":"2024-09-12T02:34:53.926540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917593+0000","last_change":"2024-09-12T02:34:53.906622+0000","last_active":"2024-09-12T02:34:54.917593+0000","last_peered":"2024-09-12T02:34:54.917593+0000","last_clean":"2024-09-12T02:34:54.917593+0000","last_became_active":"2024-09-12T02:34:53.906258+0000","last_became_peered":"2024-09-12T02:34:53.906258+0000","last_unstale":"2024-09-12T02:34:54.917593+0000","last_undegraded":"2024-09-12T02:34:54.917593+0000","last_fullsized":"2024-09-12T02:34:54.917593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.931447+0000","last_change":"2024-09-12T02:34:52.907910+0000","last_active":"2024-09-12T02:34:53.931447+0000","last_peered":"2024-09-12T02:34:53.931447+0000","last_clean":"2024-09-12T02:34:53.931447+0000","last_became_active":"2024-09-12T02:34:52.907702+0000","last_became_peered":"2024-09-12T02:34:52.907702+0000","last_unstale":"2024-09-12T02:34:53.931447+0000","last_undegraded":"2024-09-12T02:34:53.931447+0000","last_fullsized":"2024-09-12T02:34:53.931447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.894660+0000","last_change":"2024-09-12T02:34:52.894660+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.894660+0000","last_undegraded":"2024-09-12T02:34:52.894660+0000","last_fullsized":"2024-09-12T02:34:52.894660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918055+0000","last_change":"2024-09-12T02:34:52.901444+0000","last_active":"2024-09-12T02:34:54.918055+0000","last_peered":"2024-09-12T02:34:54.918055+0000","last_clean":"2024-09-12T02:34:54.918055+0000","last_became_active":"2024-09-12T02:34:52.901160+0000","last_became_peered":"2024-09-12T02:34:52.901160+0000","last_unstale":"2024-09-12T02:34:54.918055+0000","last_undegraded":"2024-09-12T02:34:54.918055+0000","last_fullsized":"2024-09-12T02:34:54.918055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.925209+0000","last_change":"2024-09-12T02:34:53.919992+0000","last_active":"2024-09-12T02:34:53.925209+0000","last_peered":"2024-09-12T02:34:53.925209+0000","last_clean":"2024-09-12T02:34:53.925209+0000","last_became_active":"2024-09-12T02:34:53.919720+0000","last_became_peered":"2024-09-12T02:34:53.919720+0000","last_unstale":"2024-09-12T02:34:53.925209+0000","last_undegraded":"2024-09-12T02:34:53.925209+0000","last_fullsized":"2024-09-12T02:34:53.925209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923722+0000","last_change":"2024-09-12T02:34:52.904482+0000","last_active":"2024-09-12T02:34:54.923722+0000","last_peered":"2024-09-12T02:34:54.923722+0000","last_clean":"2024-09-12T02:34:54.923722+0000","last_became_active":"2024-09-12T02:34:52.904051+0000","last_became_peered":"2024-09-12T02:34:52.904051+0000","last_unstale":"2024-09-12T02:34:54.923722+0000","last_undegraded":"2024-09-12T02:34:54.923722+0000","last_fullsized":"2024-09-12T02:34:54.923722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:19.941352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923728+0000","last_change":"2024-09-12T02:34:53.925259+0000","last_active":"2024-09-12T02:34:54.923728+0000","last_peered":"2024-09-12T02:34:54.923728+0000","last_clean":"2024-09-12T02:34:54.923728+0000","last_became_active":"2024-09-12T02:34:53.924603+0000","last_became_peered":"2024-09-12T02:34:53.924603+0000","last_unstale":"2024-09-12T02:34:54.923728+0000","last_undegraded":"2024-09-12T02:34:54.923728+0000","last_fullsized":"2024-09-12T02:34:54.923728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:59.262447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.936442+0000","last_change":"2024-09-12T02:34:52.904917+0000","last_active":"2024-09-12T02:34:53.936442+0000","last_peered":"2024-09-12T02:34:53.936442+0000","last_clean":"2024-09-12T02:34:53.936442+0000","last_became_active":"2024-09-12T02:34:52.904650+0000","last_became_peered":"2024-09-12T02:34:52.904650+0000","last_unstale":"2024-09-12T02:34:53.936442+0000","last_undegraded":"2024-09-12T02:34:53.936442+0000","last_fullsized":"2024-09-12T02:34:53.936442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:09.615662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917631+0000","last_change":"2024-09-12T02:34:53.930753+0000","last_active":"2024-09-12T02:34:54.917631+0000","last_peered":"2024-09-12T02:34:54.917631+0000","last_clean":"2024-09-12T02:34:54.917631+0000","last_became_active":"2024-09-12T02:34:53.930309+0000","last_became_peered":"2024-09-12T02:34:53.930309+0000","last_unstale":"2024-09-12T02:34:54.917631+0000","last_undegraded":"2024-09-12T02:34:54.917631+0000","last_fullsized":"2024-09-12T02:34:54.917631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.020340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.910539+0000","last_change":"2024-09-12T02:34:52.904914+0000","last_active":"2024-09-12T02:34:53.910539+0000","last_peered":"2024-09-12T02:34:53.910539+0000","last_clean":"2024-09-12T02:34:53.910539+0000","last_became_active":"2024-09-12T02:34:52.904645+0000","last_became_peered":"2024-09-12T02:34:52.904645+0000","last_unstale":"2024-09-12T02:34:53.910539+0000","last_undegraded":"2024-09-12T02:34:53.910539+0000","last_fullsized":"2024-09-12T02:34:53.910539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895781+0000","last_change":"2024-09-12T02:34:52.895781+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895781+0000","last_undegraded":"2024-09-12T02:34:52.895781+0000","last_fullsized":"2024-09-12T02:34:52.895781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916552+0000","last_change":"2024-09-12T02:34:52.902522+0000","last_active":"2024-09-12T02:34:54.916552+0000","last_peered":"2024-09-12T02:34:54.916552+0000","last_clean":"2024-09-12T02:34:54.916552+0000","last_became_active":"2024-09-12T02:34:52.902227+0000","last_became_peered":"2024-09-12T02:34:52.902227+0000","last_unstale":"2024-09-12T02:34:54.916552+0000","last_undegraded":"2024-09-12T02:34:54.916552+0000","last_fullsized":"2024-09-12T02:34:54.916552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901806+0000","last_change":"2024-09-12T02:34:52.899622+0000","last_active":"2024-09-12T02:34:52.901806+0000","last_peered":"2024-09-12T02:34:52.901806+0000","last_clean":"2024-09-12T02:34:52.901806+0000","last_became_active":"2024-09-12T02:34:52.899362+0000","last_became_peered":"2024-09-12T02:34:52.899362+0000","last_unstale":"2024-09-12T02:34:52.901806+0000","last_undegraded":"2024-09-12T02:34:52.901806+0000","last_fullsized":"2024-09-12T02:34:52.901806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.833616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.920416+0000","last_change":"2024-09-12T02:34:53.916634+0000","last_active":"2024-09-12T02:34:53.920416+0000","last_peered":"2024-09-12T02:34:53.920416+0000","last_clean":"2024-09-12T02:34:53.920416+0000","last_became_active":"2024-09-12T02:34:53.916359+0000","last_became_peered":"2024-09-12T02:34:53.916359+0000","last_unstale":"2024-09-12T02:34:53.920416+0000","last_undegraded":"2024-09-12T02:34:53.920416+0000","last_fullsized":"2024-09-12T02:34:53.920416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:41.622991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924062+0000","last_change":"2024-09-12T02:34:52.906658+0000","last_active":"2024-09-12T02:34:54.924062+0000","last_peered":"2024-09-12T02:34:54.924062+0000","last_clean":"2024-09-12T02:34:54.924062+0000","last_became_active":"2024-09-12T02:34:52.906388+0000","last_became_peered":"2024-09-12T02:34:52.906388+0000","last_unstale":"2024-09-12T02:34:54.924062+0000","last_undegraded":"2024-09-12T02:34:54.924062+0000","last_fullsized":"2024-09-12T02:34:54.924062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922418+0000","last_change":"2024-09-12T02:34:53.917563+0000","last_active":"2024-09-12T02:34:53.922418+0000","last_peered":"2024-09-12T02:34:53.922418+0000","last_clean":"2024-09-12T02:34:53.922418+0000","last_became_active":"2024-09-12T02:34:53.917297+0000","last_became_peered":"2024-09-12T02:34:53.917297+0000","last_unstale":"2024-09-12T02:34:53.922418+0000","last_undegraded":"2024-09-12T02:34:53.922418+0000","last_fullsized":"2024-09-12T02:34:53.922418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923999+0000","last_change":"2024-09-12T02:34:52.905778+0000","last_active":"2024-09-12T02:34:54.923999+0000","last_peered":"2024-09-12T02:34:54.923999+0000","last_clean":"2024-09-12T02:34:54.923999+0000","last_became_active":"2024-09-12T02:34:52.905458+0000","last_became_peered":"2024-09-12T02:34:52.905458+0000","last_unstale":"2024-09-12T02:34:54.923999+0000","last_undegraded":"2024-09-12T02:34:54.923999+0000","last_fullsized":"2024-09-12T02:34:54.923999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:41.923326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917105+0000","last_change":"2024-09-12T02:34:53.918308+0000","last_active":"2024-09-12T02:34:54.917105+0000","last_peered":"2024-09-12T02:34:54.917105+0000","last_clean":"2024-09-12T02:34:54.917105+0000","last_became_active":"2024-09-12T02:34:53.918025+0000","last_became_peered":"2024-09-12T02:34:53.918025+0000","last_unstale":"2024-09-12T02:34:54.917105+0000","last_undegraded":"2024-09-12T02:34:54.917105+0000","last_fullsized":"2024-09-12T02:34:54.917105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.901833+0000","last_change":"2024-09-12T02:34:52.899558+0000","last_active":"2024-09-12T02:34:52.901833+0000","last_peered":"2024-09-12T02:34:52.901833+0000","last_clean":"2024-09-12T02:34:52.901833+0000","last_became_active":"2024-09-12T02:34:52.899304+0000","last_became_peered":"2024-09-12T02:34:52.899304+0000","last_unstale":"2024-09-12T02:34:52.901833+0000","last_undegraded":"2024-09-12T02:34:52.901833+0000","last_fullsized":"2024-09-12T02:34:52.901833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:53.361266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.926578+0000","last_change":"2024-09-12T02:34:53.922769+0000","last_active":"2024-09-12T02:34:53.926578+0000","last_peered":"2024-09-12T02:34:53.926578+0000","last_clean":"2024-09-12T02:34:53.926578+0000","last_became_active":"2024-09-12T02:34:53.922500+0000","last_became_peered":"2024-09-12T02:34:53.922500+0000","last_unstale":"2024-09-12T02:34:53.926578+0000","last_undegraded":"2024-09-12T02:34:53.926578+0000","last_fullsized":"2024-09-12T02:34:53.926578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.905029+0000","last_change":"2024-09-12T02:34:52.902405+0000","last_active":"2024-09-12T02:34:52.905029+0000","last_peered":"2024-09-12T02:34:52.905029+0000","last_clean":"2024-09-12T02:34:52.905029+0000","last_became_active":"2024-09-12T02:34:52.902161+0000","last_became_peered":"2024-09-12T02:34:52.902161+0000","last_unstale":"2024-09-12T02:34:52.905029+0000","last_undegraded":"2024-09-12T02:34:52.905029+0000","last_fullsized":"2024-09-12T02:34:52.905029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.412066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892700+0000","last_change":"2024-09-12T02:34:52.892700+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892700+0000","last_undegraded":"2024-09-12T02:34:52.892700+0000","last_fullsized":"2024-09-12T02:34:52.892700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.913762+0000","last_change":"2024-09-12T02:34:52.907610+0000","last_active":"2024-09-12T02:34:53.913762+0000","last_peered":"2024-09-12T02:34:53.913762+0000","last_clean":"2024-09-12T02:34:53.913762+0000","last_became_active":"2024-09-12T02:34:52.907304+0000","last_became_peered":"2024-09-12T02:34:52.907304+0000","last_unstale":"2024-09-12T02:34:53.913762+0000","last_undegraded":"2024-09-12T02:34:53.913762+0000","last_fullsized":"2024-09-12T02:34:53.913762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921635+0000","last_change":"2024-09-12T02:34:53.919053+0000","last_active":"2024-09-12T02:34:53.921635+0000","last_peered":"2024-09-12T02:34:53.921635+0000","last_clean":"2024-09-12T02:34:53.921635+0000","last_became_active":"2024-09-12T02:34:53.918759+0000","last_became_peered":"2024-09-12T02:34:53.918759+0000","last_unstale":"2024-09-12T02:34:53.921635+0000","last_undegraded":"2024-09-12T02:34:53.921635+0000","last_fullsized":"2024-09-12T02:34:53.921635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:50.569216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.902502+0000","last_change":"2024-09-12T02:34:52.905674+0000","last_active":"2024-09-12T02:34:53.902502+0000","last_peered":"2024-09-12T02:34:53.902502+0000","last_clean":"2024-09-12T02:34:53.902502+0000","last_became_active":"2024-09-12T02:34:52.905397+0000","last_became_peered":"2024-09-12T02:34:52.905397+0000","last_unstale":"2024-09-12T02:34:53.902502+0000","last_undegraded":"2024-09-12T02:34:53.902502+0000","last_fullsized":"2024-09-12T02:34:53.902502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895448+0000","last_change":"2024-09-12T02:34:52.895448+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895448+0000","last_undegraded":"2024-09-12T02:34:52.895448+0000","last_fullsized":"2024-09-12T02:34:52.895448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.937384+0000","last_change":"2024-09-12T02:34:52.907996+0000","last_active":"2024-09-12T02:34:53.937384+0000","last_peered":"2024-09-12T02:34:53.937384+0000","last_clean":"2024-09-12T02:34:53.937384+0000","last_became_active":"2024-09-12T02:34:52.907553+0000","last_became_peered":"2024-09-12T02:34:52.907553+0000","last_unstale":"2024-09-12T02:34:53.937384+0000","last_undegraded":"2024-09-12T02:34:53.937384+0000","last_fullsized":"2024-09-12T02:34:53.937384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:59.248306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.892914+0000","last_change":"2024-09-12T02:34:52.892914+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.892914+0000","last_undegraded":"2024-09-12T02:34:52.892914+0000","last_fullsized":"2024-09-12T02:34:52.892914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924064+0000","last_change":"2024-09-12T02:34:52.907895+0000","last_active":"2024-09-12T02:34:54.924064+0000","last_peered":"2024-09-12T02:34:54.924064+0000","last_clean":"2024-09-12T02:34:54.924064+0000","last_became_active":"2024-09-12T02:34:52.907619+0000","last_became_peered":"2024-09-12T02:34:52.907619+0000","last_unstale":"2024-09-12T02:34:54.924064+0000","last_undegraded":"2024-09-12T02:34:54.924064+0000","last_fullsized":"2024-09-12T02:34:54.924064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923917+0000","last_change":"2024-09-12T02:34:53.929988+0000","last_active":"2024-09-12T02:34:54.923917+0000","last_peered":"2024-09-12T02:34:54.923917+0000","last_clean":"2024-09-12T02:34:54.923917+0000","last_became_active":"2024-09-12T02:34:53.929710+0000","last_became_peered":"2024-09-12T02:34:53.929710+0000","last_unstale":"2024-09-12T02:34:54.923917+0000","last_undegraded":"2024-09-12T02:34:54.923917+0000","last_fullsized":"2024-09-12T02:34:54.923917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:45.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917705+0000","last_change":"2024-09-12T02:34:52.905107+0000","last_active":"2024-09-12T02:34:54.917705+0000","last_peered":"2024-09-12T02:34:54.917705+0000","last_clean":"2024-09-12T02:34:54.917705+0000","last_became_active":"2024-09-12T02:34:52.904818+0000","last_became_peered":"2024-09-12T02:34:52.904818+0000","last_unstale":"2024-09-12T02:34:54.917705+0000","last_undegraded":"2024-09-12T02:34:54.917705+0000","last_fullsized":"2024-09-12T02:34:54.917705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917432+0000","last_change":"2024-09-12T02:34:53.919967+0000","last_active":"2024-09-12T02:34:54.917432+0000","last_peered":"2024-09-12T02:34:54.917432+0000","last_clean":"2024-09-12T02:34:54.917432+0000","last_became_active":"2024-09-12T02:34:53.919660+0000","last_became_peered":"2024-09-12T02:34:53.919660+0000","last_unstale":"2024-09-12T02:34:54.917432+0000","last_undegraded":"2024-09-12T02:34:54.917432+0000","last_fullsized":"2024-09-12T02:34:54.917432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888257+0000","last_change":"2024-09-12T02:34:51.888257+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888257+0000","last_undegraded":"2024-09-12T02:34:51.888257+0000","last_fullsized":"2024-09-12T02:34:51.888257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:34:52.883066+0000","last_change":"2024-09-12T02:34:52.883066+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.883066+0000","last_undegraded":"2024-09-12T02:34:52.883066+0000","last_fullsized":"2024-09-12T02:34:52.883066+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.911000+0000","last_change":"2024-09-12T02:34:52.907743+0000","last_active":"2024-09-12T02:34:53.911000+0000","last_peered":"2024-09-12T02:34:53.911000+0000","last_clean":"2024-09-12T02:34:53.911000+0000","last_became_active":"2024-09-12T02:34:52.907497+0000","last_became_peered":"2024-09-12T02:34:52.907497+0000","last_unstale":"2024-09-12T02:34:53.911000+0000","last_undegraded":"2024-09-12T02:34:53.911000+0000","last_fullsized":"2024-09-12T02:34:53.911000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.921075+0000","last_change":"2024-09-12T02:34:53.920142+0000","last_active":"2024-09-12T02:34:53.921075+0000","last_peered":"2024-09-12T02:34:53.921075+0000","last_clean":"2024-09-12T02:34:53.921075+0000","last_became_active":"2024-09-12T02:34:53.919863+0000","last_became_peered":"2024-09-12T02:34:53.919863+0000","last_unstale":"2024-09-12T02:34:53.921075+0000","last_undegraded":"2024-09-12T02:34:53.921075+0000","last_fullsized":"2024-09-12T02:34:53.921075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888252+0000","last_change":"2024-09-12T02:34:51.888252+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888252+0000","last_undegraded":"2024-09-12T02:34:51.888252+0000","last_fullsized":"2024-09-12T02:34:51.888252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922382+0000","last_change":"2024-09-12T02:34:53.917794+0000","last_active":"2024-09-12T02:34:53.922382+0000","last_peered":"2024-09-12T02:34:53.922382+0000","last_clean":"2024-09-12T02:34:53.922382+0000","last_became_active":"2024-09-12T02:34:53.917420+0000","last_became_peered":"2024-09-12T02:34:53.917420+0000","last_unstale":"2024-09-12T02:34:53.922382+0000","last_undegraded":"2024-09-12T02:34:53.922382+0000","last_fullsized":"2024-09-12T02:34:53.922382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.227214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888239+0000","last_change":"2024-09-12T02:34:51.888239+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888239+0000","last_undegraded":"2024-09-12T02:34:51.888239+0000","last_fullsized":"2024-09-12T02:34:51.888239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923653+0000","last_change":"2024-09-12T02:34:53.924920+0000","last_active":"2024-09-12T02:34:54.923653+0000","last_peered":"2024-09-12T02:34:54.923653+0000","last_clean":"2024-09-12T02:34:54.923653+0000","last_became_active":"2024-09-12T02:34:53.924608+0000","last_became_peered":"2024-09-12T02:34:53.924608+0000","last_unstale":"2024-09-12T02:34:54.923653+0000","last_undegraded":"2024-09-12T02:34:54.923653+0000","last_fullsized":"2024-09-12T02:34:54.923653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:44.806726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908337+0000","last_change":"2024-09-12T02:34:52.897781+0000","last_active":"2024-09-12T02:34:53.908337+0000","last_peered":"2024-09-12T02:34:53.908337+0000","last_clean":"2024-09-12T02:34:53.908337+0000","last_became_active":"2024-09-12T02:34:52.897505+0000","last_became_peered":"2024-09-12T02:34:52.897505+0000","last_unstale":"2024-09-12T02:34:53.908337+0000","last_undegraded":"2024-09-12T02:34:53.908337+0000","last_fullsized":"2024-09-12T02:34:53.908337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:38.366747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.895096+0000","last_change":"2024-09-12T02:34:52.895096+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.895096+0000","last_undegraded":"2024-09-12T02:34:52.895096+0000","last_fullsized":"2024-09-12T02:34:52.895096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.888007+0000","last_change":"2024-09-12T02:34:51.888007+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.888007+0000","last_undegraded":"2024-09-12T02:34:51.888007+0000","last_fullsized":"2024-09-12T02:34:51.888007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.933097+0000","last_change":"2024-09-12T02:34:53.930914+0000","last_active":"2024-09-12T02:34:53.933097+0000","last_peered":"2024-09-12T02:34:53.933097+0000","last_clean":"2024-09-12T02:34:53.933097+0000","last_became_active":"2024-09-12T02:34:53.930647+0000","last_became_peered":"2024-09-12T02:34:53.930647+0000","last_unstale":"2024-09-12T02:34:53.933097+0000","last_undegraded":"2024-09-12T02:34:53.933097+0000","last_fullsized":"2024-09-12T02:34:53.933097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:42.927888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924162+0000","last_change":"2024-09-12T02:34:52.905872+0000","last_active":"2024-09-12T02:34:54.924162+0000","last_peered":"2024-09-12T02:34:54.924162+0000","last_clean":"2024-09-12T02:34:54.924162+0000","last_became_active":"2024-09-12T02:34:52.905610+0000","last_became_peered":"2024-09-12T02:34:52.905610+0000","last_unstale":"2024-09-12T02:34:54.924162+0000","last_undegraded":"2024-09-12T02:34:54.924162+0000","last_fullsized":"2024-09-12T02:34:54.924162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:20.308041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.920439+0000","last_change":"2024-09-12T02:34:53.916708+0000","last_active":"2024-09-12T02:34:53.920439+0000","last_peered":"2024-09-12T02:34:53.920439+0000","last_clean":"2024-09-12T02:34:53.920439+0000","last_became_active":"2024-09-12T02:34:53.916406+0000","last_became_peered":"2024-09-12T02:34:53.916406+0000","last_unstale":"2024-09-12T02:34:53.920439+0000","last_undegraded":"2024-09-12T02:34:53.920439+0000","last_fullsized":"2024-09-12T02:34:53.920439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:30.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T02:34:51.887613+0000","last_change":"2024-09-12T02:34:51.887613+0000","last_active":"2024-09-12T02:34:51.878505+0000","last_peered":"2024-09-12T02:34:51.878505+0000","last_clean":"2024-09-12T02:34:51.878505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:51.887613+0000","last_undegraded":"2024-09-12T02:34:51.887613+0000","last_fullsized":"2024-09-12T02:34:51.887613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T02:34:52.891836+0000","last_change":"2024-09-12T02:34:52.891836+0000","last_active":"2024-09-12T02:34:52.883066+0000","last_peered":"2024-09-12T02:34:52.883066+0000","last_clean":"2024-09-12T02:34:52.883066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:34:52.891836+0000","last_undegraded":"2024-09-12T02:34:52.891836+0000","last_fullsized":"2024-09-12T02:34:52.891836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.907540+0000","last_change":"2024-09-12T02:34:52.898024+0000","last_active":"2024-09-12T02:34:53.907540+0000","last_peered":"2024-09-12T02:34:53.907540+0000","last_clean":"2024-09-12T02:34:53.907540+0000","last_became_active":"2024-09-12T02:34:52.897771+0000","last_became_peered":"2024-09-12T02:34:52.897771+0000","last_unstale":"2024-09-12T02:34:53.907540+0000","last_undegraded":"2024-09-12T02:34:53.907540+0000","last_fullsized":"2024-09-12T02:34:53.907540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.919349+0000","last_change":"2024-09-12T02:34:53.916828+0000","last_active":"2024-09-12T02:34:53.919349+0000","last_peered":"2024-09-12T02:34:53.919349+0000","last_clean":"2024-09-12T02:34:53.919349+0000","last_became_active":"2024-09-12T02:34:53.916543+0000","last_became_peered":"2024-09-12T02:34:53.916543+0000","last_unstale":"2024-09-12T02:34:53.919349+0000","last_undegraded":"2024-09-12T02:34:53.919349+0000","last_fullsized":"2024-09-12T02:34:53.919349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:21.312602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908630+0000","last_change":"2024-09-12T02:34:52.896981+0000","last_active":"2024-09-12T02:34:53.908630+0000","last_peered":"2024-09-12T02:34:53.908630+0000","last_clean":"2024-09-12T02:34:53.908630+0000","last_became_active":"2024-09-12T02:34:52.896728+0000","last_became_peered":"2024-09-12T02:34:52.896728+0000","last_unstale":"2024-09-12T02:34:53.908630+0000","last_undegraded":"2024-09-12T02:34:53.908630+0000","last_fullsized":"2024-09-12T02:34:53.908630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:51.190888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.922569+0000","last_change":"2024-09-12T02:34:53.917338+0000","last_active":"2024-09-12T02:34:53.922569+0000","last_peered":"2024-09-12T02:34:53.922569+0000","last_clean":"2024-09-12T02:34:53.922569+0000","last_became_active":"2024-09-12T02:34:53.917083+0000","last_became_peered":"2024-09-12T02:34:53.917083+0000","last_unstale":"2024-09-12T02:34:53.922569+0000","last_undegraded":"2024-09-12T02:34:53.922569+0000","last_fullsized":"2024-09-12T02:34:53.922569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.903380+0000","last_change":"2024-09-12T02:34:52.899652+0000","last_active":"2024-09-12T02:34:53.903380+0000","last_peered":"2024-09-12T02:34:53.903380+0000","last_clean":"2024-09-12T02:34:53.903380+0000","last_became_active":"2024-09-12T02:34:52.899400+0000","last_became_peered":"2024-09-12T02:34:52.899400+0000","last_unstale":"2024-09-12T02:34:53.903380+0000","last_undegraded":"2024-09-12T02:34:53.903380+0000","last_fullsized":"2024-09-12T02:34:53.903380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.376482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917485+0000","last_change":"2024-09-12T02:34:53.915187+0000","last_active":"2024-09-12T02:34:54.917485+0000","last_peered":"2024-09-12T02:34:54.917485+0000","last_clean":"2024-09-12T02:34:54.917485+0000","last_became_active":"2024-09-12T02:34:53.914912+0000","last_became_peered":"2024-09-12T02:34:53.914912+0000","last_unstale":"2024-09-12T02:34:54.917485+0000","last_undegraded":"2024-09-12T02:34:54.917485+0000","last_fullsized":"2024-09-12T02:34:54.917485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916676+0000","last_change":"2024-09-12T02:34:52.901417+0000","last_active":"2024-09-12T02:34:54.916676+0000","last_peered":"2024-09-12T02:34:54.916676+0000","last_clean":"2024-09-12T02:34:54.916676+0000","last_became_active":"2024-09-12T02:34:52.901140+0000","last_became_peered":"2024-09-12T02:34:52.901140+0000","last_unstale":"2024-09-12T02:34:54.916676+0000","last_undegraded":"2024-09-12T02:34:54.916676+0000","last_fullsized":"2024-09-12T02:34:54.916676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.918367+0000","last_change":"2024-09-12T02:34:53.917211+0000","last_active":"2024-09-12T02:34:53.918367+0000","last_peered":"2024-09-12T02:34:53.918367+0000","last_clean":"2024-09-12T02:34:53.918367+0000","last_became_active":"2024-09-12T02:34:53.916853+0000","last_became_peered":"2024-09-12T02:34:53.916853+0000","last_unstale":"2024-09-12T02:34:53.918367+0000","last_undegraded":"2024-09-12T02:34:53.918367+0000","last_fullsized":"2024-09-12T02:34:53.918367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.030651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T02:34:52.902019+0000","last_change":"2024-09-12T02:34:52.899954+0000","last_active":"2024-09-12T02:34:52.902019+0000","last_peered":"2024-09-12T02:34:52.902019+0000","last_clean":"2024-09-12T02:34:52.902019+0000","last_became_active":"2024-09-12T02:34:52.899233+0000","last_became_peered":"2024-09-12T02:34:52.899233+0000","last_unstale":"2024-09-12T02:34:52.902019+0000","last_undegraded":"2024-09-12T02:34:52.902019+0000","last_fullsized":"2024-09-12T02:34:52.902019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:03.154855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923987+0000","last_change":"2024-09-12T02:34:53.931173+0000","last_active":"2024-09-12T02:34:54.923987+0000","last_peered":"2024-09-12T02:34:54.923987+0000","last_clean":"2024-09-12T02:34:54.923987+0000","last_became_active":"2024-09-12T02:34:53.930915+0000","last_became_peered":"2024-09-12T02:34:53.930915+0000","last_unstale":"2024-09-12T02:34:54.923987+0000","last_undegraded":"2024-09-12T02:34:54.923987+0000","last_fullsized":"2024-09-12T02:34:54.923987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:47.854136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.908942+0000","last_change":"2024-09-12T02:34:52.899556+0000","last_active":"2024-09-12T02:34:53.908942+0000","last_peered":"2024-09-12T02:34:53.908942+0000","last_clean":"2024-09-12T02:34:53.908942+0000","last_became_active":"2024-09-12T02:34:52.899205+0000","last_became_peered":"2024-09-12T02:34:52.899205+0000","last_unstale":"2024-09-12T02:34:53.908942+0000","last_undegraded":"2024-09-12T02:34:53.908942+0000","last_fullsized":"2024-09-12T02:34:53.908942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T02:34:53.906853+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:53.906853+0000","last_peered":"2024-09-12T02:34:53.906853+0000","last_clean":"2024-09-12T02:34:53.906853+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:53.906853+0000","last_undegraded":"2024-09-12T02:34:53.906853+0000","last_fullsized":"2024-09-12T02:34:53.906853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":781535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476754,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":196781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":425984,"data_stored":182318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":772686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":175651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:34:58.807 INFO:tasks.ceph.mds.b.smithi153.stderr:2024-09-12T02:34:58.806+0000 7f1c1759a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:34:59.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:59.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:01.335 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.445+0000 7f838cc4c640 1 Processor -- start 2024-09-12T02:35:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.445+0000 7f838cc4c640 1 -- start start 2024-09-12T02:35:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.446+0000 7f838cc4c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388162060 0x7f83880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.446+0000 7f838cc4c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83880b64b0 0x7f83880b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.446+0000 7f838cc4c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f838806d9f0 con 0x7f8388161c80 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.446+0000 7f838cc4c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f838806dcd0 con 0x7f83880b64b0 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.446+0000 7f838cc4c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f838806dfb0 con 0x7f8388162060 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83880b64b0 0x7f83880b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83880b64b0 0x7f83880b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42948/0 (socket says 172.21.15.119:42948) 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 -- 172.21.15.119:0/3580331280 learned_addr learned my addr 172.21.15.119:0/3580331280 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8385d9b640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388162060 0x7f83880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 -- 172.21.15.119:0/3580331280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388162060 msgr2=0x7f83880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388162060 0x7f83880b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 -- 172.21.15.119:0/3580331280 >> v1:172.21.15.153:6789/0 conn(0x7f8388161c80 legacy=0x7f838806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.447+0000 7f8386d9d640 1 -- 172.21.15.119:0/3580331280 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880d01f0 con 0x7f83880b64b0 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f8386d9d640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880b6960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8378009e50 tx=0x7f837802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e8e16156a87f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f838559a640 1 -- 172.21.15.119:0/3580331280 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378036070 con 0x7f83880b64b0 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f838559a640 1 -- 172.21.15.119:0/3580331280 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378031600 con 0x7f83880b64b0 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f838559a640 1 -- 172.21.15.119:0/3580331280 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780319d0 con 0x7f83880b64b0 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f838cc4c640 1 -- 172.21.15.119:0/3580331280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 msgr2=0x7f83880b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.448+0000 7f838cc4c640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880b6960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8378009e50 tx=0x7f837802a710 comp rx=0 tx=0).stop 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 -- 172.21.15.119:0/3580331280 shutdown_connections 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880b6960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 --2- 172.21.15.119:0/3580331280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388162060 0x7f83880b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 -- 172.21.15.119:0/3580331280 >> 172.21.15.119:0/3580331280 conn(0x7f83880d44f0 msgr2=0x7f83880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 -- 172.21.15.119:0/3580331280 shutdown_connections 2024-09-12T02:35:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.449+0000 7f838cc4c640 1 -- 172.21.15.119:0/3580331280 wait complete. 2024-09-12T02:35:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.450+0000 7f838cc4c640 1 Processor -- start 2024-09-12T02:35:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.450+0000 7f838cc4c640 1 -- start start 2024-09-12T02:35:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388161c80 0x7f83880b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8388162060 0x7f8388159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83880cf1e0 con 0x7f83880b64b0 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83880d2aa0 con 0x7f8388162060 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f83880cf360 con 0x7f8388161c80 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42956/0 (socket says 172.21.15.119:42956) 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 -- 172.21.15.119:0/118704078 learned_addr learned my addr 172.21.15.119:0/118704078 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f8385d9b640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388161c80 0x7f83880b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f8386d9d640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8388162060 0x7f8388159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 -- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388161c80 msgr2=0x7f83880b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388161c80 0x7f83880b9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 -- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8388162060 msgr2=0x7f8388159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8388162060 0x7f8388159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 -- 172.21.15.119:0/118704078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880cc6b0 con 0x7f83880b64b0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838659c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f838000c400 tx=0x7f838000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800052d0 con 0x7f83880b64b0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8380005490 con 0x7f83880b64b0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.451+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83880cc990 con 0x7f83880b64b0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.452+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380007260 con 0x7f83880b64b0 2024-09-12T02:35:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.452+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83880b7340 con 0x7f83880b64b0 2024-09-12T02:35:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.453+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83880ce8a0 con 0x7f83880b64b0 2024-09-12T02:35:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.453+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8380007400 con 0x7f83880b64b0 2024-09-12T02:35:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.453+0000 7f837effd640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 0x7f836806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.454+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f838008a3f0 con 0x7f83880b64b0 2024-09-12T02:35:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.454+0000 7f8385d9b640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 0x7f836806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.454+0000 7f8385d9b640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 0x7f836806e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f838815a120 tx=0x7f8370009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.458+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8380058650 con 0x7f83880b64b0 2024-09-12T02:35:01.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.620+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83880b5070 con 0x7f836806be60 2024-09-12T02:35:01.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.626+0000 7f837effd640 1 -- 172.21.15.119:0/118704078 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251883 (secure 0 0 0) 0x7f83880b5070 con 0x7f836806be60 2024-09-12T02:35:01.629 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 msgr2=0x7f836806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 0x7f836806e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f838815a120 tx=0x7f8370009190 comp rx=0 tx=0).stop 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 msgr2=0x7f83880cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f838000c400 tx=0x7f838000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 shutdown_connections 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f836806be60 0x7f836806e320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8388162060 0x7f8388159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8388161c80 0x7f83880b9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 --2- 172.21.15.119:0/118704078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83880b64b0 0x7f83880cbfd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 >> 172.21.15.119:0/118704078 conn(0x7f83880d44f0 msgr2=0x7f838806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 shutdown_connections 2024-09-12T02:35:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.629+0000 7f838cc4c640 1 -- 172.21.15.119:0/118704078 wait complete. 2024-09-12T02:35:01.640 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-12T02:35:01.191888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220996,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753724,"statfs":{"total":773094113280,"available":772867813376,"internally_reserved":0,"allocated":4857856,"data_stored":2754972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001432"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916277+0000","last_change":"2024-09-12T02:34:53.920327+0000","last_active":"2024-09-12T02:34:54.916277+0000","last_peered":"2024-09-12T02:34:54.916277+0000","last_clean":"2024-09-12T02:34:54.916277+0000","last_became_active":"2024-09-12T02:34:53.920070+0000","last_became_peered":"2024-09-12T02:34:53.920070+0000","last_unstale":"2024-09-12T02:34:54.916277+0000","last_undegraded":"2024-09-12T02:34:54.916277+0000","last_fullsized":"2024-09-12T02:34:54.916277+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:13.363397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916098+0000","last_change":"2024-09-12T02:34:53.917979+0000","last_active":"2024-09-12T02:34:54.916098+0000","last_peered":"2024-09-12T02:34:54.916098+0000","last_clean":"2024-09-12T02:34:54.916098+0000","last_became_active":"2024-09-12T02:34:53.916267+0000","last_became_peered":"2024-09-12T02:34:53.916267+0000","last_unstale":"2024-09-12T02:34:54.916098+0000","last_undegraded":"2024-09-12T02:34:54.916098+0000","last_fullsized":"2024-09-12T02:34:54.916098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:13.355113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843754+0000","last_change":"2024-09-12T02:34:53.925071+0000","last_active":"2024-09-12T02:34:55.843754+0000","last_peered":"2024-09-12T02:34:55.843754+0000","last_clean":"2024-09-12T02:34:55.843754+0000","last_became_active":"2024-09-12T02:34:53.924546+0000","last_became_peered":"2024-09-12T02:34:53.924546+0000","last_unstale":"2024-09-12T02:34:55.843754+0000","last_undegraded":"2024-09-12T02:34:55.843754+0000","last_fullsized":"2024-09-12T02:34:55.843754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.014723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918918+0000","last_change":"2024-09-12T02:34:53.920605+0000","last_active":"2024-09-12T02:34:54.918918+0000","last_peered":"2024-09-12T02:34:54.918918+0000","last_clean":"2024-09-12T02:34:54.918918+0000","last_became_active":"2024-09-12T02:34:53.920349+0000","last_became_peered":"2024-09-12T02:34:53.920349+0000","last_unstale":"2024-09-12T02:34:54.918918+0000","last_undegraded":"2024-09-12T02:34:54.918918+0000","last_fullsized":"2024-09-12T02:34:54.918918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.280334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918711+0000","last_change":"2024-09-12T02:34:53.919110+0000","last_active":"2024-09-12T02:34:54.918711+0000","last_peered":"2024-09-12T02:34:54.918711+0000","last_clean":"2024-09-12T02:34:54.918711+0000","last_became_active":"2024-09-12T02:34:53.918853+0000","last_became_peered":"2024-09-12T02:34:53.918853+0000","last_unstale":"2024-09-12T02:34:54.918711+0000","last_undegraded":"2024-09-12T02:34:54.918711+0000","last_fullsized":"2024-09-12T02:34:54.918711+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.361436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843299+0000","last_change":"2024-09-12T02:34:53.926491+0000","last_active":"2024-09-12T02:34:55.843299+0000","last_peered":"2024-09-12T02:34:55.843299+0000","last_clean":"2024-09-12T02:34:55.843299+0000","last_became_active":"2024-09-12T02:34:53.926211+0000","last_became_peered":"2024-09-12T02:34:53.926211+0000","last_unstale":"2024-09-12T02:34:55.843299+0000","last_undegraded":"2024-09-12T02:34:55.843299+0000","last_fullsized":"2024-09-12T02:34:55.843299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923494+0000","last_change":"2024-09-12T02:34:53.931710+0000","last_active":"2024-09-12T02:34:54.923494+0000","last_peered":"2024-09-12T02:34:54.923494+0000","last_clean":"2024-09-12T02:34:54.923494+0000","last_became_active":"2024-09-12T02:34:53.931441+0000","last_became_peered":"2024-09-12T02:34:53.931441+0000","last_unstale":"2024-09-12T02:34:54.923494+0000","last_undegraded":"2024-09-12T02:34:54.923494+0000","last_fullsized":"2024-09-12T02:34:54.923494+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:15.773861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.915884+0000","last_change":"2024-09-12T02:34:53.922166+0000","last_active":"2024-09-12T02:34:54.915884+0000","last_peered":"2024-09-12T02:34:54.915884+0000","last_clean":"2024-09-12T02:34:54.915884+0000","last_became_active":"2024-09-12T02:34:53.921876+0000","last_became_peered":"2024-09-12T02:34:53.921876+0000","last_unstale":"2024-09-12T02:34:54.915884+0000","last_undegraded":"2024-09-12T02:34:54.915884+0000","last_fullsized":"2024-09-12T02:34:54.915884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:27.536532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843956+0000","last_change":"2024-09-12T02:34:53.922929+0000","last_active":"2024-09-12T02:34:55.843956+0000","last_peered":"2024-09-12T02:34:55.843956+0000","last_clean":"2024-09-12T02:34:55.843956+0000","last_became_active":"2024-09-12T02:34:53.922520+0000","last_became_peered":"2024-09-12T02:34:53.922520+0000","last_unstale":"2024-09-12T02:34:55.843956+0000","last_undegraded":"2024-09-12T02:34:55.843956+0000","last_fullsized":"2024-09-12T02:34:55.843956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:15.773861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923946+0000","last_change":"2024-09-12T02:34:53.928906+0000","last_active":"2024-09-12T02:34:54.923946+0000","last_peered":"2024-09-12T02:34:54.923946+0000","last_clean":"2024-09-12T02:34:54.923946+0000","last_became_active":"2024-09-12T02:34:53.928621+0000","last_became_peered":"2024-09-12T02:34:53.928621+0000","last_unstale":"2024-09-12T02:34:54.923946+0000","last_undegraded":"2024-09-12T02:34:54.923946+0000","last_fullsized":"2024-09-12T02:34:54.923946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:47.050346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923907+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923907+0000","last_peered":"2024-09-12T02:34:54.923907+0000","last_clean":"2024-09-12T02:34:54.923907+0000","last_became_active":"2024-09-12T02:34:53.924943+0000","last_became_peered":"2024-09-12T02:34:53.924943+0000","last_unstale":"2024-09-12T02:34:54.923907+0000","last_undegraded":"2024-09-12T02:34:54.923907+0000","last_fullsized":"2024-09-12T02:34:54.923907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:59.114212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843502+0000","last_change":"2024-09-12T02:34:53.916964+0000","last_active":"2024-09-12T02:34:55.843502+0000","last_peered":"2024-09-12T02:34:55.843502+0000","last_clean":"2024-09-12T02:34:55.843502+0000","last_became_active":"2024-09-12T02:34:53.916680+0000","last_became_peered":"2024-09-12T02:34:53.916680+0000","last_unstale":"2024-09-12T02:34:55.843502+0000","last_undegraded":"2024-09-12T02:34:55.843502+0000","last_fullsized":"2024-09-12T02:34:55.843502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:27.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923582+0000","last_change":"2024-09-12T02:34:53.929140+0000","last_active":"2024-09-12T02:34:54.923582+0000","last_peered":"2024-09-12T02:34:54.923582+0000","last_clean":"2024-09-12T02:34:54.923582+0000","last_became_active":"2024-09-12T02:34:53.928842+0000","last_became_peered":"2024-09-12T02:34:53.928842+0000","last_unstale":"2024-09-12T02:34:54.923582+0000","last_undegraded":"2024-09-12T02:34:54.923582+0000","last_fullsized":"2024-09-12T02:34:54.923582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.169910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917126+0000","last_change":"2024-09-12T02:34:53.906988+0000","last_active":"2024-09-12T02:34:54.917126+0000","last_peered":"2024-09-12T02:34:54.917126+0000","last_clean":"2024-09-12T02:34:54.917126+0000","last_became_active":"2024-09-12T02:34:53.906697+0000","last_became_peered":"2024-09-12T02:34:53.906697+0000","last_unstale":"2024-09-12T02:34:54.917126+0000","last_undegraded":"2024-09-12T02:34:54.917126+0000","last_fullsized":"2024-09-12T02:34:54.917126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923527+0000","last_change":"2024-09-12T02:34:53.925435+0000","last_active":"2024-09-12T02:34:54.923527+0000","last_peered":"2024-09-12T02:34:54.923527+0000","last_clean":"2024-09-12T02:34:54.923527+0000","last_became_active":"2024-09-12T02:34:53.925046+0000","last_became_peered":"2024-09-12T02:34:53.925046+0000","last_unstale":"2024-09-12T02:34:54.923527+0000","last_undegraded":"2024-09-12T02:34:54.923527+0000","last_fullsized":"2024-09-12T02:34:54.923527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:30.672733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342627+0000","last_change":"2024-09-12T02:34:53.922618+0000","last_active":"2024-09-12T02:34:55.342627+0000","last_peered":"2024-09-12T02:34:55.342627+0000","last_clean":"2024-09-12T02:34:55.342627+0000","last_became_active":"2024-09-12T02:34:53.922054+0000","last_became_peered":"2024-09-12T02:34:53.922054+0000","last_unstale":"2024-09-12T02:34:55.342627+0000","last_undegraded":"2024-09-12T02:34:55.342627+0000","last_fullsized":"2024-09-12T02:34:55.342627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343110+0000","last_change":"2024-09-12T02:34:53.923038+0000","last_active":"2024-09-12T02:34:55.343110+0000","last_peered":"2024-09-12T02:34:55.343110+0000","last_clean":"2024-09-12T02:34:55.343110+0000","last_became_active":"2024-09-12T02:34:53.922649+0000","last_became_peered":"2024-09-12T02:34:53.922649+0000","last_unstale":"2024-09-12T02:34:55.343110+0000","last_undegraded":"2024-09-12T02:34:55.343110+0000","last_fullsized":"2024-09-12T02:34:55.343110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.330981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917034+0000","last_change":"2024-09-12T02:34:53.907701+0000","last_active":"2024-09-12T02:34:54.917034+0000","last_peered":"2024-09-12T02:34:54.917034+0000","last_clean":"2024-09-12T02:34:54.917034+0000","last_became_active":"2024-09-12T02:34:53.907425+0000","last_became_peered":"2024-09-12T02:34:53.907425+0000","last_unstale":"2024-09-12T02:34:54.917034+0000","last_undegraded":"2024-09-12T02:34:54.917034+0000","last_fullsized":"2024-09-12T02:34:54.917034+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:30.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918924+0000","last_change":"2024-09-12T02:34:53.922931+0000","last_active":"2024-09-12T02:34:54.918924+0000","last_peered":"2024-09-12T02:34:54.918924+0000","last_clean":"2024-09-12T02:34:54.918924+0000","last_became_active":"2024-09-12T02:34:53.922633+0000","last_became_peered":"2024-09-12T02:34:53.922633+0000","last_unstale":"2024-09-12T02:34:54.918924+0000","last_undegraded":"2024-09-12T02:34:54.918924+0000","last_fullsized":"2024-09-12T02:34:54.918924+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:34.510081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917135+0000","last_change":"2024-09-12T02:34:53.908746+0000","last_active":"2024-09-12T02:34:54.917135+0000","last_peered":"2024-09-12T02:34:54.917135+0000","last_clean":"2024-09-12T02:34:54.917135+0000","last_became_active":"2024-09-12T02:34:53.908484+0000","last_became_peered":"2024-09-12T02:34:53.908484+0000","last_unstale":"2024-09-12T02:34:54.917135+0000","last_undegraded":"2024-09-12T02:34:54.917135+0000","last_fullsized":"2024-09-12T02:34:54.917135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.030651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923665+0000","last_change":"2024-09-12T02:34:53.926067+0000","last_active":"2024-09-12T02:34:54.923665+0000","last_peered":"2024-09-12T02:34:54.923665+0000","last_clean":"2024-09-12T02:34:54.923665+0000","last_became_active":"2024-09-12T02:34:53.925776+0000","last_became_peered":"2024-09-12T02:34:53.925776+0000","last_unstale":"2024-09-12T02:34:54.923665+0000","last_undegraded":"2024-09-12T02:34:54.923665+0000","last_fullsized":"2024-09-12T02:34:54.923665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:41.377035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917344+0000","last_change":"2024-09-12T02:34:53.919856+0000","last_active":"2024-09-12T02:34:54.917344+0000","last_peered":"2024-09-12T02:34:54.917344+0000","last_clean":"2024-09-12T02:34:54.917344+0000","last_became_active":"2024-09-12T02:34:53.918841+0000","last_became_peered":"2024-09-12T02:34:53.918841+0000","last_unstale":"2024-09-12T02:34:54.917344+0000","last_undegraded":"2024-09-12T02:34:54.917344+0000","last_fullsized":"2024-09-12T02:34:54.917344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342684+0000","last_change":"2024-09-12T02:34:53.921158+0000","last_active":"2024-09-12T02:34:55.342684+0000","last_peered":"2024-09-12T02:34:55.342684+0000","last_clean":"2024-09-12T02:34:55.342684+0000","last_became_active":"2024-09-12T02:34:53.920889+0000","last_became_peered":"2024-09-12T02:34:53.920889+0000","last_unstale":"2024-09-12T02:34:55.342684+0000","last_undegraded":"2024-09-12T02:34:55.342684+0000","last_fullsized":"2024-09-12T02:34:55.342684+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:23.643205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918673+0000","last_change":"2024-09-12T02:34:53.914713+0000","last_active":"2024-09-12T02:34:54.918673+0000","last_peered":"2024-09-12T02:34:54.918673+0000","last_clean":"2024-09-12T02:34:54.918673+0000","last_became_active":"2024-09-12T02:34:53.914105+0000","last_became_peered":"2024-09-12T02:34:53.914105+0000","last_unstale":"2024-09-12T02:34:54.918673+0000","last_undegraded":"2024-09-12T02:34:54.918673+0000","last_fullsized":"2024-09-12T02:34:54.918673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:08.317441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917723+0000","last_change":"2024-09-12T02:34:53.920936+0000","last_active":"2024-09-12T02:34:54.917723+0000","last_peered":"2024-09-12T02:34:54.917723+0000","last_clean":"2024-09-12T02:34:54.917723+0000","last_became_active":"2024-09-12T02:34:53.920663+0000","last_became_peered":"2024-09-12T02:34:53.920663+0000","last_unstale":"2024-09-12T02:34:54.917723+0000","last_undegraded":"2024-09-12T02:34:54.917723+0000","last_fullsized":"2024-09-12T02:34:54.917723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:52.195450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843619+0000","last_change":"2024-09-12T02:34:53.931129+0000","last_active":"2024-09-12T02:34:55.843619+0000","last_peered":"2024-09-12T02:34:55.843619+0000","last_clean":"2024-09-12T02:34:55.843619+0000","last_became_active":"2024-09-12T02:34:53.930795+0000","last_became_peered":"2024-09-12T02:34:53.930795+0000","last_unstale":"2024-09-12T02:34:55.843619+0000","last_undegraded":"2024-09-12T02:34:55.843619+0000","last_fullsized":"2024-09-12T02:34:55.843619+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917464+0000","last_change":"2024-09-12T02:34:53.919417+0000","last_active":"2024-09-12T02:34:54.917464+0000","last_peered":"2024-09-12T02:34:54.917464+0000","last_clean":"2024-09-12T02:34:54.917464+0000","last_became_active":"2024-09-12T02:34:53.919134+0000","last_became_peered":"2024-09-12T02:34:53.919134+0000","last_unstale":"2024-09-12T02:34:54.917464+0000","last_undegraded":"2024-09-12T02:34:54.917464+0000","last_fullsized":"2024-09-12T02:34:54.917464+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:50.569216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923830+0000","last_change":"2024-09-12T02:34:53.932447+0000","last_active":"2024-09-12T02:34:54.923830+0000","last_peered":"2024-09-12T02:34:54.923830+0000","last_clean":"2024-09-12T02:34:54.923830+0000","last_became_active":"2024-09-12T02:34:53.931915+0000","last_became_peered":"2024-09-12T02:34:53.931915+0000","last_unstale":"2024-09-12T02:34:54.923830+0000","last_undegraded":"2024-09-12T02:34:54.923830+0000","last_fullsized":"2024-09-12T02:34:54.923830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:52.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917909+0000","last_change":"2024-09-12T02:34:53.919705+0000","last_active":"2024-09-12T02:34:54.917909+0000","last_peered":"2024-09-12T02:34:54.917909+0000","last_clean":"2024-09-12T02:34:54.917909+0000","last_became_active":"2024-09-12T02:34:53.919433+0000","last_became_peered":"2024-09-12T02:34:53.919433+0000","last_unstale":"2024-09-12T02:34:54.917909+0000","last_undegraded":"2024-09-12T02:34:54.917909+0000","last_fullsized":"2024-09-12T02:34:54.917909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:46.459716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916896+0000","last_change":"2024-09-12T02:34:53.914329+0000","last_active":"2024-09-12T02:34:54.916896+0000","last_peered":"2024-09-12T02:34:54.916896+0000","last_clean":"2024-09-12T02:34:54.916896+0000","last_became_active":"2024-09-12T02:34:53.914049+0000","last_became_peered":"2024-09-12T02:34:53.914049+0000","last_unstale":"2024-09-12T02:34:54.916896+0000","last_undegraded":"2024-09-12T02:34:54.916896+0000","last_fullsized":"2024-09-12T02:34:54.916896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:41.622991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342909+0000","last_change":"2024-09-12T02:34:53.919485+0000","last_active":"2024-09-12T02:34:55.342909+0000","last_peered":"2024-09-12T02:34:55.342909+0000","last_clean":"2024-09-12T02:34:55.342909+0000","last_became_active":"2024-09-12T02:34:53.919198+0000","last_became_peered":"2024-09-12T02:34:53.919198+0000","last_unstale":"2024-09-12T02:34:55.342909+0000","last_undegraded":"2024-09-12T02:34:55.342909+0000","last_fullsized":"2024-09-12T02:34:55.342909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843150+0000","last_change":"2024-09-12T02:34:53.918077+0000","last_active":"2024-09-12T02:34:55.843150+0000","last_peered":"2024-09-12T02:34:55.843150+0000","last_clean":"2024-09-12T02:34:55.843150+0000","last_became_active":"2024-09-12T02:34:53.917730+0000","last_became_peered":"2024-09-12T02:34:53.917730+0000","last_unstale":"2024-09-12T02:34:55.843150+0000","last_undegraded":"2024-09-12T02:34:55.843150+0000","last_fullsized":"2024-09-12T02:34:55.843150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343098+0000","last_change":"2024-09-12T02:34:53.931065+0000","last_active":"2024-09-12T02:34:55.343098+0000","last_peered":"2024-09-12T02:34:55.343098+0000","last_clean":"2024-09-12T02:34:55.343098+0000","last_became_active":"2024-09-12T02:34:53.930797+0000","last_became_peered":"2024-09-12T02:34:53.930797+0000","last_unstale":"2024-09-12T02:34:55.343098+0000","last_undegraded":"2024-09-12T02:34:55.343098+0000","last_fullsized":"2024-09-12T02:34:55.343098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:27.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917850+0000","last_change":"2024-09-12T02:34:52.905869+0000","last_active":"2024-09-12T02:34:54.917850+0000","last_peered":"2024-09-12T02:34:54.917850+0000","last_clean":"2024-09-12T02:34:54.917850+0000","last_became_active":"2024-09-12T02:34:52.905438+0000","last_became_peered":"2024-09-12T02:34:52.905438+0000","last_unstale":"2024-09-12T02:34:54.917850+0000","last_undegraded":"2024-09-12T02:34:54.917850+0000","last_fullsized":"2024-09-12T02:34:54.917850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:37.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843656+0000","last_change":"2024-09-12T02:34:53.925843+0000","last_active":"2024-09-12T02:34:55.843656+0000","last_peered":"2024-09-12T02:34:55.843656+0000","last_clean":"2024-09-12T02:34:55.843656+0000","last_became_active":"2024-09-12T02:34:53.925579+0000","last_became_peered":"2024-09-12T02:34:53.925579+0000","last_unstale":"2024-09-12T02:34:55.843656+0000","last_undegraded":"2024-09-12T02:34:55.843656+0000","last_fullsized":"2024-09-12T02:34:55.843656+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843665+0000","last_change":"2024-09-12T02:34:52.897888+0000","last_active":"2024-09-12T02:34:55.843665+0000","last_peered":"2024-09-12T02:34:55.843665+0000","last_clean":"2024-09-12T02:34:55.843665+0000","last_became_active":"2024-09-12T02:34:52.897621+0000","last_became_peered":"2024-09-12T02:34:52.897621+0000","last_unstale":"2024-09-12T02:34:55.843665+0000","last_undegraded":"2024-09-12T02:34:55.843665+0000","last_fullsized":"2024-09-12T02:34:55.843665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917593+0000","last_change":"2024-09-12T02:34:53.906622+0000","last_active":"2024-09-12T02:34:54.917593+0000","last_peered":"2024-09-12T02:34:54.917593+0000","last_clean":"2024-09-12T02:34:54.917593+0000","last_became_active":"2024-09-12T02:34:53.906258+0000","last_became_peered":"2024-09-12T02:34:53.906258+0000","last_unstale":"2024-09-12T02:34:54.917593+0000","last_undegraded":"2024-09-12T02:34:54.917593+0000","last_fullsized":"2024-09-12T02:34:54.917593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843725+0000","last_change":"2024-09-12T02:34:52.907910+0000","last_active":"2024-09-12T02:34:55.843725+0000","last_peered":"2024-09-12T02:34:55.843725+0000","last_clean":"2024-09-12T02:34:55.843725+0000","last_became_active":"2024-09-12T02:34:52.907702+0000","last_became_peered":"2024-09-12T02:34:52.907702+0000","last_unstale":"2024-09-12T02:34:55.843725+0000","last_undegraded":"2024-09-12T02:34:55.843725+0000","last_fullsized":"2024-09-12T02:34:55.843725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916383+0000","last_change":"2024-09-12T02:34:53.915382+0000","last_active":"2024-09-12T02:34:54.916383+0000","last_peered":"2024-09-12T02:34:54.916383+0000","last_clean":"2024-09-12T02:34:54.916383+0000","last_became_active":"2024-09-12T02:34:53.915117+0000","last_became_peered":"2024-09-12T02:34:53.915117+0000","last_unstale":"2024-09-12T02:34:54.916383+0000","last_undegraded":"2024-09-12T02:34:54.916383+0000","last_fullsized":"2024-09-12T02:34:54.916383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:22.423098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918055+0000","last_change":"2024-09-12T02:34:52.901444+0000","last_active":"2024-09-12T02:34:54.918055+0000","last_peered":"2024-09-12T02:34:54.918055+0000","last_clean":"2024-09-12T02:34:54.918055+0000","last_became_active":"2024-09-12T02:34:52.901160+0000","last_became_peered":"2024-09-12T02:34:52.901160+0000","last_unstale":"2024-09-12T02:34:54.918055+0000","last_undegraded":"2024-09-12T02:34:54.918055+0000","last_fullsized":"2024-09-12T02:34:54.918055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843155+0000","last_change":"2024-09-12T02:34:53.919992+0000","last_active":"2024-09-12T02:34:55.843155+0000","last_peered":"2024-09-12T02:34:55.843155+0000","last_clean":"2024-09-12T02:34:55.843155+0000","last_became_active":"2024-09-12T02:34:53.919720+0000","last_became_peered":"2024-09-12T02:34:53.919720+0000","last_unstale":"2024-09-12T02:34:55.843155+0000","last_undegraded":"2024-09-12T02:34:55.843155+0000","last_fullsized":"2024-09-12T02:34:55.843155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923722+0000","last_change":"2024-09-12T02:34:52.904482+0000","last_active":"2024-09-12T02:34:54.923722+0000","last_peered":"2024-09-12T02:34:54.923722+0000","last_clean":"2024-09-12T02:34:54.923722+0000","last_became_active":"2024-09-12T02:34:52.904051+0000","last_became_peered":"2024-09-12T02:34:52.904051+0000","last_unstale":"2024-09-12T02:34:54.923722+0000","last_undegraded":"2024-09-12T02:34:54.923722+0000","last_fullsized":"2024-09-12T02:34:54.923722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:19.941352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923728+0000","last_change":"2024-09-12T02:34:53.925259+0000","last_active":"2024-09-12T02:34:54.923728+0000","last_peered":"2024-09-12T02:34:54.923728+0000","last_clean":"2024-09-12T02:34:54.923728+0000","last_became_active":"2024-09-12T02:34:53.924603+0000","last_became_peered":"2024-09-12T02:34:53.924603+0000","last_unstale":"2024-09-12T02:34:54.923728+0000","last_undegraded":"2024-09-12T02:34:54.923728+0000","last_fullsized":"2024-09-12T02:34:54.923728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:59.262447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342734+0000","last_change":"2024-09-12T02:34:52.904917+0000","last_active":"2024-09-12T02:34:55.342734+0000","last_peered":"2024-09-12T02:34:55.342734+0000","last_clean":"2024-09-12T02:34:55.342734+0000","last_became_active":"2024-09-12T02:34:52.904650+0000","last_became_peered":"2024-09-12T02:34:52.904650+0000","last_unstale":"2024-09-12T02:34:55.342734+0000","last_undegraded":"2024-09-12T02:34:55.342734+0000","last_fullsized":"2024-09-12T02:34:55.342734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:09.615662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917631+0000","last_change":"2024-09-12T02:34:53.930753+0000","last_active":"2024-09-12T02:34:54.917631+0000","last_peered":"2024-09-12T02:34:54.917631+0000","last_clean":"2024-09-12T02:34:54.917631+0000","last_became_active":"2024-09-12T02:34:53.930309+0000","last_became_peered":"2024-09-12T02:34:53.930309+0000","last_unstale":"2024-09-12T02:34:54.917631+0000","last_undegraded":"2024-09-12T02:34:54.917631+0000","last_fullsized":"2024-09-12T02:34:54.917631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.020340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843335+0000","last_change":"2024-09-12T02:34:52.904914+0000","last_active":"2024-09-12T02:34:55.843335+0000","last_peered":"2024-09-12T02:34:55.843335+0000","last_clean":"2024-09-12T02:34:55.843335+0000","last_became_active":"2024-09-12T02:34:52.904645+0000","last_became_peered":"2024-09-12T02:34:52.904645+0000","last_unstale":"2024-09-12T02:34:55.843335+0000","last_undegraded":"2024-09-12T02:34:55.843335+0000","last_fullsized":"2024-09-12T02:34:55.843335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:40.618429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916159+0000","last_change":"2024-09-12T02:34:53.915901+0000","last_active":"2024-09-12T02:34:54.916159+0000","last_peered":"2024-09-12T02:34:54.916159+0000","last_clean":"2024-09-12T02:34:54.916159+0000","last_became_active":"2024-09-12T02:34:53.915601+0000","last_became_peered":"2024-09-12T02:34:53.915601+0000","last_unstale":"2024-09-12T02:34:54.916159+0000","last_undegraded":"2024-09-12T02:34:54.916159+0000","last_fullsized":"2024-09-12T02:34:54.916159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:35.996478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916552+0000","last_change":"2024-09-12T02:34:52.902522+0000","last_active":"2024-09-12T02:34:54.916552+0000","last_peered":"2024-09-12T02:34:54.916552+0000","last_clean":"2024-09-12T02:34:54.916552+0000","last_became_active":"2024-09-12T02:34:52.902227+0000","last_became_peered":"2024-09-12T02:34:52.902227+0000","last_unstale":"2024-09-12T02:34:54.916552+0000","last_undegraded":"2024-09-12T02:34:54.916552+0000","last_fullsized":"2024-09-12T02:34:54.916552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:02.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918931+0000","last_change":"2024-09-12T02:34:53.919942+0000","last_active":"2024-09-12T02:34:54.918931+0000","last_peered":"2024-09-12T02:34:54.918931+0000","last_clean":"2024-09-12T02:34:54.918931+0000","last_became_active":"2024-09-12T02:34:53.919488+0000","last_became_peered":"2024-09-12T02:34:53.919488+0000","last_unstale":"2024-09-12T02:34:54.918931+0000","last_undegraded":"2024-09-12T02:34:54.918931+0000","last_fullsized":"2024-09-12T02:34:54.918931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:24.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916369+0000","last_change":"2024-09-12T02:34:52.899622+0000","last_active":"2024-09-12T02:34:54.916369+0000","last_peered":"2024-09-12T02:34:54.916369+0000","last_clean":"2024-09-12T02:34:54.916369+0000","last_became_active":"2024-09-12T02:34:52.899362+0000","last_became_peered":"2024-09-12T02:34:52.899362+0000","last_unstale":"2024-09-12T02:34:54.916369+0000","last_undegraded":"2024-09-12T02:34:54.916369+0000","last_fullsized":"2024-09-12T02:34:54.916369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:21.125835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343158+0000","last_change":"2024-09-12T02:34:53.916634+0000","last_active":"2024-09-12T02:34:55.343158+0000","last_peered":"2024-09-12T02:34:55.343158+0000","last_clean":"2024-09-12T02:34:55.343158+0000","last_became_active":"2024-09-12T02:34:53.916359+0000","last_became_peered":"2024-09-12T02:34:53.916359+0000","last_unstale":"2024-09-12T02:34:55.343158+0000","last_undegraded":"2024-09-12T02:34:55.343158+0000","last_fullsized":"2024-09-12T02:34:55.343158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.014723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924062+0000","last_change":"2024-09-12T02:34:52.906658+0000","last_active":"2024-09-12T02:34:54.924062+0000","last_peered":"2024-09-12T02:34:54.924062+0000","last_clean":"2024-09-12T02:34:54.924062+0000","last_became_active":"2024-09-12T02:34:52.906388+0000","last_became_peered":"2024-09-12T02:34:52.906388+0000","last_unstale":"2024-09-12T02:34:54.924062+0000","last_undegraded":"2024-09-12T02:34:54.924062+0000","last_fullsized":"2024-09-12T02:34:54.924062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843574+0000","last_change":"2024-09-12T02:34:53.917563+0000","last_active":"2024-09-12T02:34:55.843574+0000","last_peered":"2024-09-12T02:34:55.843574+0000","last_clean":"2024-09-12T02:34:55.843574+0000","last_became_active":"2024-09-12T02:34:53.917297+0000","last_became_peered":"2024-09-12T02:34:53.917297+0000","last_unstale":"2024-09-12T02:34:55.843574+0000","last_undegraded":"2024-09-12T02:34:55.843574+0000","last_fullsized":"2024-09-12T02:34:55.843574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:19.174756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923999+0000","last_change":"2024-09-12T02:34:52.905778+0000","last_active":"2024-09-12T02:34:54.923999+0000","last_peered":"2024-09-12T02:34:54.923999+0000","last_clean":"2024-09-12T02:34:54.923999+0000","last_became_active":"2024-09-12T02:34:52.905458+0000","last_became_peered":"2024-09-12T02:34:52.905458+0000","last_unstale":"2024-09-12T02:34:54.923999+0000","last_undegraded":"2024-09-12T02:34:54.923999+0000","last_fullsized":"2024-09-12T02:34:54.923999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:41.923326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917105+0000","last_change":"2024-09-12T02:34:53.918308+0000","last_active":"2024-09-12T02:34:54.917105+0000","last_peered":"2024-09-12T02:34:54.917105+0000","last_clean":"2024-09-12T02:34:54.917105+0000","last_became_active":"2024-09-12T02:34:53.918025+0000","last_became_peered":"2024-09-12T02:34:53.918025+0000","last_unstale":"2024-09-12T02:34:54.917105+0000","last_undegraded":"2024-09-12T02:34:54.917105+0000","last_fullsized":"2024-09-12T02:34:54.917105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:54.980007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916382+0000","last_change":"2024-09-12T02:34:52.899558+0000","last_active":"2024-09-12T02:34:54.916382+0000","last_peered":"2024-09-12T02:34:54.916382+0000","last_clean":"2024-09-12T02:34:54.916382+0000","last_became_active":"2024-09-12T02:34:52.899304+0000","last_became_peered":"2024-09-12T02:34:52.899304+0000","last_unstale":"2024-09-12T02:34:54.916382+0000","last_undegraded":"2024-09-12T02:34:54.916382+0000","last_fullsized":"2024-09-12T02:34:54.916382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:55.022078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843091+0000","last_change":"2024-09-12T02:34:53.922769+0000","last_active":"2024-09-12T02:34:55.843091+0000","last_peered":"2024-09-12T02:34:55.843091+0000","last_clean":"2024-09-12T02:34:55.843091+0000","last_became_active":"2024-09-12T02:34:53.922500+0000","last_became_peered":"2024-09-12T02:34:53.922500+0000","last_unstale":"2024-09-12T02:34:55.843091+0000","last_undegraded":"2024-09-12T02:34:55.843091+0000","last_fullsized":"2024-09-12T02:34:55.843091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916320+0000","last_change":"2024-09-12T02:34:52.902405+0000","last_active":"2024-09-12T02:34:54.916320+0000","last_peered":"2024-09-12T02:34:54.916320+0000","last_clean":"2024-09-12T02:34:54.916320+0000","last_became_active":"2024-09-12T02:34:52.902161+0000","last_became_peered":"2024-09-12T02:34:52.902161+0000","last_unstale":"2024-09-12T02:34:54.916320+0000","last_undegraded":"2024-09-12T02:34:54.916320+0000","last_fullsized":"2024-09-12T02:34:54.916320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:58.708110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.915981+0000","last_change":"2024-09-12T02:34:53.919823+0000","last_active":"2024-09-12T02:34:54.915981+0000","last_peered":"2024-09-12T02:34:54.915981+0000","last_clean":"2024-09-12T02:34:54.915981+0000","last_became_active":"2024-09-12T02:34:53.918840+0000","last_became_peered":"2024-09-12T02:34:53.918840+0000","last_unstale":"2024-09-12T02:34:54.915981+0000","last_undegraded":"2024-09-12T02:34:54.915981+0000","last_fullsized":"2024-09-12T02:34:54.915981+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.010681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843393+0000","last_change":"2024-09-12T02:34:52.907610+0000","last_active":"2024-09-12T02:34:55.843393+0000","last_peered":"2024-09-12T02:34:55.843393+0000","last_clean":"2024-09-12T02:34:55.843393+0000","last_became_active":"2024-09-12T02:34:52.907304+0000","last_became_peered":"2024-09-12T02:34:52.907304+0000","last_unstale":"2024-09-12T02:34:55.843393+0000","last_undegraded":"2024-09-12T02:34:55.843393+0000","last_fullsized":"2024-09-12T02:34:55.843393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342858+0000","last_change":"2024-09-12T02:34:53.919053+0000","last_active":"2024-09-12T02:34:55.342858+0000","last_peered":"2024-09-12T02:34:55.342858+0000","last_clean":"2024-09-12T02:34:55.342858+0000","last_became_active":"2024-09-12T02:34:53.918759+0000","last_became_peered":"2024-09-12T02:34:53.918759+0000","last_unstale":"2024-09-12T02:34:55.342858+0000","last_undegraded":"2024-09-12T02:34:55.342858+0000","last_fullsized":"2024-09-12T02:34:55.342858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916616+0000","last_change":"2024-09-12T02:34:52.905674+0000","last_active":"2024-09-12T02:34:54.916616+0000","last_peered":"2024-09-12T02:34:54.916616+0000","last_clean":"2024-09-12T02:34:54.916616+0000","last_became_active":"2024-09-12T02:34:52.905397+0000","last_became_peered":"2024-09-12T02:34:52.905397+0000","last_unstale":"2024-09-12T02:34:54.916616+0000","last_undegraded":"2024-09-12T02:34:54.916616+0000","last_fullsized":"2024-09-12T02:34:54.916616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916231+0000","last_change":"2024-09-12T02:34:53.919574+0000","last_active":"2024-09-12T02:34:54.916231+0000","last_peered":"2024-09-12T02:34:54.916231+0000","last_clean":"2024-09-12T02:34:54.916231+0000","last_became_active":"2024-09-12T02:34:53.919303+0000","last_became_peered":"2024-09-12T02:34:53.919303+0000","last_unstale":"2024-09-12T02:34:54.916231+0000","last_undegraded":"2024-09-12T02:34:54.916231+0000","last_fullsized":"2024-09-12T02:34:54.916231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:24.074603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342638+0000","last_change":"2024-09-12T02:34:52.907996+0000","last_active":"2024-09-12T02:34:55.342638+0000","last_peered":"2024-09-12T02:34:55.342638+0000","last_clean":"2024-09-12T02:34:55.342638+0000","last_became_active":"2024-09-12T02:34:52.907553+0000","last_became_peered":"2024-09-12T02:34:52.907553+0000","last_unstale":"2024-09-12T02:34:55.342638+0000","last_undegraded":"2024-09-12T02:34:55.342638+0000","last_fullsized":"2024-09-12T02:34:55.342638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:59.248306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916348+0000","last_change":"2024-09-12T02:34:53.915356+0000","last_active":"2024-09-12T02:34:54.916348+0000","last_peered":"2024-09-12T02:34:54.916348+0000","last_clean":"2024-09-12T02:34:54.916348+0000","last_became_active":"2024-09-12T02:34:53.915082+0000","last_became_peered":"2024-09-12T02:34:53.915082+0000","last_unstale":"2024-09-12T02:34:54.916348+0000","last_undegraded":"2024-09-12T02:34:54.916348+0000","last_fullsized":"2024-09-12T02:34:54.916348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:02.332935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924064+0000","last_change":"2024-09-12T02:34:52.907895+0000","last_active":"2024-09-12T02:34:54.924064+0000","last_peered":"2024-09-12T02:34:54.924064+0000","last_clean":"2024-09-12T02:34:54.924064+0000","last_became_active":"2024-09-12T02:34:52.907619+0000","last_became_peered":"2024-09-12T02:34:52.907619+0000","last_unstale":"2024-09-12T02:34:54.924064+0000","last_undegraded":"2024-09-12T02:34:54.924064+0000","last_fullsized":"2024-09-12T02:34:54.924064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:45.455154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923917+0000","last_change":"2024-09-12T02:34:53.929988+0000","last_active":"2024-09-12T02:34:54.923917+0000","last_peered":"2024-09-12T02:34:54.923917+0000","last_clean":"2024-09-12T02:34:54.923917+0000","last_became_active":"2024-09-12T02:34:53.929710+0000","last_became_peered":"2024-09-12T02:34:53.929710+0000","last_unstale":"2024-09-12T02:34:54.923917+0000","last_undegraded":"2024-09-12T02:34:54.923917+0000","last_fullsized":"2024-09-12T02:34:54.923917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:45.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917705+0000","last_change":"2024-09-12T02:34:52.905107+0000","last_active":"2024-09-12T02:34:54.917705+0000","last_peered":"2024-09-12T02:34:54.917705+0000","last_clean":"2024-09-12T02:34:54.917705+0000","last_became_active":"2024-09-12T02:34:52.904818+0000","last_became_peered":"2024-09-12T02:34:52.904818+0000","last_unstale":"2024-09-12T02:34:54.917705+0000","last_undegraded":"2024-09-12T02:34:54.917705+0000","last_fullsized":"2024-09-12T02:34:54.917705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917432+0000","last_change":"2024-09-12T02:34:53.919967+0000","last_active":"2024-09-12T02:34:54.917432+0000","last_peered":"2024-09-12T02:34:54.917432+0000","last_clean":"2024-09-12T02:34:54.917432+0000","last_became_active":"2024-09-12T02:34:53.919660+0000","last_became_peered":"2024-09-12T02:34:53.919660+0000","last_unstale":"2024-09-12T02:34:54.917432+0000","last_undegraded":"2024-09-12T02:34:54.917432+0000","last_fullsized":"2024-09-12T02:34:54.917432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918989+0000","last_change":"2024-09-12T02:34:52.898621+0000","last_active":"2024-09-12T02:34:54.918989+0000","last_peered":"2024-09-12T02:34:54.918989+0000","last_clean":"2024-09-12T02:34:54.918989+0000","last_became_active":"2024-09-12T02:34:52.898384+0000","last_became_peered":"2024-09-12T02:34:52.898384+0000","last_unstale":"2024-09-12T02:34:54.918989+0000","last_undegraded":"2024-09-12T02:34:54.918989+0000","last_fullsized":"2024-09-12T02:34:54.918989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:33.646413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.919118+0000","last_change":"2024-09-12T02:34:53.920454+0000","last_active":"2024-09-12T02:34:54.919118+0000","last_peered":"2024-09-12T02:34:54.919118+0000","last_clean":"2024-09-12T02:34:54.919118+0000","last_became_active":"2024-09-12T02:34:53.919179+0000","last_became_peered":"2024-09-12T02:34:53.919179+0000","last_unstale":"2024-09-12T02:34:54.919118+0000","last_undegraded":"2024-09-12T02:34:54.919118+0000","last_fullsized":"2024-09-12T02:34:54.919118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:21.194450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843608+0000","last_change":"2024-09-12T02:34:52.907743+0000","last_active":"2024-09-12T02:34:55.843608+0000","last_peered":"2024-09-12T02:34:55.843608+0000","last_clean":"2024-09-12T02:34:55.843608+0000","last_became_active":"2024-09-12T02:34:52.907497+0000","last_became_peered":"2024-09-12T02:34:52.907497+0000","last_unstale":"2024-09-12T02:34:55.843608+0000","last_undegraded":"2024-09-12T02:34:55.843608+0000","last_fullsized":"2024-09-12T02:34:55.843608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.377611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343004+0000","last_change":"2024-09-12T02:34:53.920142+0000","last_active":"2024-09-12T02:34:55.343004+0000","last_peered":"2024-09-12T02:34:55.343004+0000","last_clean":"2024-09-12T02:34:55.343004+0000","last_became_active":"2024-09-12T02:34:53.919863+0000","last_became_peered":"2024-09-12T02:34:53.919863+0000","last_unstale":"2024-09-12T02:34:55.343004+0000","last_undegraded":"2024-09-12T02:34:55.343004+0000","last_fullsized":"2024-09-12T02:34:55.343004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918743+0000","last_change":"2024-09-12T02:34:52.899220+0000","last_active":"2024-09-12T02:34:54.918743+0000","last_peered":"2024-09-12T02:34:54.918743+0000","last_clean":"2024-09-12T02:34:54.918743+0000","last_became_active":"2024-09-12T02:34:52.898966+0000","last_became_peered":"2024-09-12T02:34:52.898966+0000","last_unstale":"2024-09-12T02:34:54.918743+0000","last_undegraded":"2024-09-12T02:34:54.918743+0000","last_fullsized":"2024-09-12T02:34:54.918743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:25.967813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843227+0000","last_change":"2024-09-12T02:34:53.917794+0000","last_active":"2024-09-12T02:34:55.843227+0000","last_peered":"2024-09-12T02:34:55.843227+0000","last_clean":"2024-09-12T02:34:55.843227+0000","last_became_active":"2024-09-12T02:34:53.917420+0000","last_became_peered":"2024-09-12T02:34:53.917420+0000","last_unstale":"2024-09-12T02:34:55.843227+0000","last_undegraded":"2024-09-12T02:34:55.843227+0000","last_fullsized":"2024-09-12T02:34:55.843227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.020340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918640+0000","last_change":"2024-09-12T02:34:52.902538+0000","last_active":"2024-09-12T02:34:54.918640+0000","last_peered":"2024-09-12T02:34:54.918640+0000","last_clean":"2024-09-12T02:34:54.918640+0000","last_became_active":"2024-09-12T02:34:52.902259+0000","last_became_peered":"2024-09-12T02:34:52.902259+0000","last_unstale":"2024-09-12T02:34:54.918640+0000","last_undegraded":"2024-09-12T02:34:54.918640+0000","last_fullsized":"2024-09-12T02:34:54.918640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:11.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923653+0000","last_change":"2024-09-12T02:34:53.924920+0000","last_active":"2024-09-12T02:34:54.923653+0000","last_peered":"2024-09-12T02:34:54.923653+0000","last_clean":"2024-09-12T02:34:54.923653+0000","last_became_active":"2024-09-12T02:34:53.924608+0000","last_became_peered":"2024-09-12T02:34:53.924608+0000","last_unstale":"2024-09-12T02:34:54.923653+0000","last_undegraded":"2024-09-12T02:34:54.923653+0000","last_fullsized":"2024-09-12T02:34:54.923653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:44.806726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342999+0000","last_change":"2024-09-12T02:34:52.897781+0000","last_active":"2024-09-12T02:34:55.342999+0000","last_peered":"2024-09-12T02:34:55.342999+0000","last_clean":"2024-09-12T02:34:55.342999+0000","last_became_active":"2024-09-12T02:34:52.897505+0000","last_became_peered":"2024-09-12T02:34:52.897505+0000","last_unstale":"2024-09-12T02:34:55.342999+0000","last_undegraded":"2024-09-12T02:34:55.342999+0000","last_fullsized":"2024-09-12T02:34:55.342999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:38.366747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916288+0000","last_change":"2024-09-12T02:34:53.915190+0000","last_active":"2024-09-12T02:34:54.916288+0000","last_peered":"2024-09-12T02:34:54.916288+0000","last_clean":"2024-09-12T02:34:54.916288+0000","last_became_active":"2024-09-12T02:34:53.914795+0000","last_became_peered":"2024-09-12T02:34:53.914795+0000","last_unstale":"2024-09-12T02:34:54.916288+0000","last_undegraded":"2024-09-12T02:34:54.916288+0000","last_fullsized":"2024-09-12T02:34:54.916288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:14.622060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.918566+0000","last_change":"2024-09-12T02:34:52.898501+0000","last_active":"2024-09-12T02:34:54.918566+0000","last_peered":"2024-09-12T02:34:54.918566+0000","last_clean":"2024-09-12T02:34:54.918566+0000","last_became_active":"2024-09-12T02:34:52.898263+0000","last_became_peered":"2024-09-12T02:34:52.898263+0000","last_unstale":"2024-09-12T02:34:54.918566+0000","last_undegraded":"2024-09-12T02:34:54.918566+0000","last_fullsized":"2024-09-12T02:34:54.918566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:38.922027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843518+0000","last_change":"2024-09-12T02:34:53.930914+0000","last_active":"2024-09-12T02:34:55.843518+0000","last_peered":"2024-09-12T02:34:55.843518+0000","last_clean":"2024-09-12T02:34:55.843518+0000","last_became_active":"2024-09-12T02:34:53.930647+0000","last_became_peered":"2024-09-12T02:34:53.930647+0000","last_unstale":"2024-09-12T02:34:55.843518+0000","last_undegraded":"2024-09-12T02:34:55.843518+0000","last_fullsized":"2024-09-12T02:34:55.843518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.688032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.924162+0000","last_change":"2024-09-12T02:34:52.905872+0000","last_active":"2024-09-12T02:34:54.924162+0000","last_peered":"2024-09-12T02:34:54.924162+0000","last_clean":"2024-09-12T02:34:54.924162+0000","last_became_active":"2024-09-12T02:34:52.905610+0000","last_became_peered":"2024-09-12T02:34:52.905610+0000","last_unstale":"2024-09-12T02:34:54.924162+0000","last_undegraded":"2024-09-12T02:34:54.924162+0000","last_fullsized":"2024-09-12T02:34:54.924162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:20.308041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343007+0000","last_change":"2024-09-12T02:34:53.916708+0000","last_active":"2024-09-12T02:34:55.343007+0000","last_peered":"2024-09-12T02:34:55.343007+0000","last_clean":"2024-09-12T02:34:55.343007+0000","last_became_active":"2024-09-12T02:34:53.916406+0000","last_became_peered":"2024-09-12T02:34:53.916406+0000","last_unstale":"2024-09-12T02:34:55.343007+0000","last_undegraded":"2024-09-12T02:34:55.343007+0000","last_fullsized":"2024-09-12T02:34:55.343007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.020340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.919051+0000","last_change":"2024-09-12T02:34:52.904807+0000","last_active":"2024-09-12T02:34:54.919051+0000","last_peered":"2024-09-12T02:34:54.919051+0000","last_clean":"2024-09-12T02:34:54.919051+0000","last_became_active":"2024-09-12T02:34:52.904538+0000","last_became_peered":"2024-09-12T02:34:52.904538+0000","last_unstale":"2024-09-12T02:34:54.919051+0000","last_undegraded":"2024-09-12T02:34:54.919051+0000","last_fullsized":"2024-09-12T02:34:54.919051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:52.822884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916131+0000","last_change":"2024-09-12T02:34:53.912434+0000","last_active":"2024-09-12T02:34:54.916131+0000","last_peered":"2024-09-12T02:34:54.916131+0000","last_clean":"2024-09-12T02:34:54.916131+0000","last_became_active":"2024-09-12T02:34:53.912153+0000","last_became_peered":"2024-09-12T02:34:53.912153+0000","last_unstale":"2024-09-12T02:34:54.916131+0000","last_undegraded":"2024-09-12T02:34:54.916131+0000","last_fullsized":"2024-09-12T02:34:54.916131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:03.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843793+0000","last_change":"2024-09-12T02:34:52.898024+0000","last_active":"2024-09-12T02:34:55.843793+0000","last_peered":"2024-09-12T02:34:55.843793+0000","last_clean":"2024-09-12T02:34:55.843793+0000","last_became_active":"2024-09-12T02:34:52.897771+0000","last_became_peered":"2024-09-12T02:34:52.897771+0000","last_unstale":"2024-09-12T02:34:55.843793+0000","last_undegraded":"2024-09-12T02:34:55.843793+0000","last_fullsized":"2024-09-12T02:34:55.843793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.564654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843236+0000","last_change":"2024-09-12T02:34:53.916828+0000","last_active":"2024-09-12T02:34:55.843236+0000","last_peered":"2024-09-12T02:34:55.843236+0000","last_clean":"2024-09-12T02:34:55.843236+0000","last_became_active":"2024-09-12T02:34:53.916543+0000","last_became_peered":"2024-09-12T02:34:53.916543+0000","last_unstale":"2024-09-12T02:34:55.843236+0000","last_undegraded":"2024-09-12T02:34:55.843236+0000","last_fullsized":"2024-09-12T02:34:55.843236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.330981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843596+0000","last_change":"2024-09-12T02:34:52.896981+0000","last_active":"2024-09-12T02:34:55.843596+0000","last_peered":"2024-09-12T02:34:55.843596+0000","last_clean":"2024-09-12T02:34:55.843596+0000","last_became_active":"2024-09-12T02:34:52.896728+0000","last_became_peered":"2024-09-12T02:34:52.896728+0000","last_unstale":"2024-09-12T02:34:55.843596+0000","last_undegraded":"2024-09-12T02:34:55.843596+0000","last_fullsized":"2024-09-12T02:34:55.843596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:51.190888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.843240+0000","last_change":"2024-09-12T02:34:53.917338+0000","last_active":"2024-09-12T02:34:55.843240+0000","last_peered":"2024-09-12T02:34:55.843240+0000","last_clean":"2024-09-12T02:34:55.843240+0000","last_became_active":"2024-09-12T02:34:53.917083+0000","last_became_peered":"2024-09-12T02:34:53.917083+0000","last_unstale":"2024-09-12T02:34:55.843240+0000","last_undegraded":"2024-09-12T02:34:55.843240+0000","last_fullsized":"2024-09-12T02:34:55.843240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.415892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916825+0000","last_change":"2024-09-12T02:34:52.899652+0000","last_active":"2024-09-12T02:34:54.916825+0000","last_peered":"2024-09-12T02:34:54.916825+0000","last_clean":"2024-09-12T02:34:54.916825+0000","last_became_active":"2024-09-12T02:34:52.899400+0000","last_became_peered":"2024-09-12T02:34:52.899400+0000","last_unstale":"2024-09-12T02:34:54.916825+0000","last_undegraded":"2024-09-12T02:34:54.916825+0000","last_fullsized":"2024-09-12T02:34:54.916825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.376482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.917485+0000","last_change":"2024-09-12T02:34:53.915187+0000","last_active":"2024-09-12T02:34:54.917485+0000","last_peered":"2024-09-12T02:34:54.917485+0000","last_clean":"2024-09-12T02:34:54.917485+0000","last_became_active":"2024-09-12T02:34:53.914912+0000","last_became_peered":"2024-09-12T02:34:53.914912+0000","last_unstale":"2024-09-12T02:34:54.917485+0000","last_undegraded":"2024-09-12T02:34:54.917485+0000","last_fullsized":"2024-09-12T02:34:54.917485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:11.090276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.916676+0000","last_change":"2024-09-12T02:34:52.901417+0000","last_active":"2024-09-12T02:34:54.916676+0000","last_peered":"2024-09-12T02:34:54.916676+0000","last_clean":"2024-09-12T02:34:54.916676+0000","last_became_active":"2024-09-12T02:34:52.901140+0000","last_became_peered":"2024-09-12T02:34:52.901140+0000","last_unstale":"2024-09-12T02:34:54.916676+0000","last_undegraded":"2024-09-12T02:34:54.916676+0000","last_fullsized":"2024-09-12T02:34:54.916676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343124+0000","last_change":"2024-09-12T02:34:53.917211+0000","last_active":"2024-09-12T02:34:55.343124+0000","last_peered":"2024-09-12T02:34:55.343124+0000","last_clean":"2024-09-12T02:34:55.343124+0000","last_became_active":"2024-09-12T02:34:53.916853+0000","last_became_peered":"2024-09-12T02:34:53.916853+0000","last_unstale":"2024-09-12T02:34:55.343124+0000","last_undegraded":"2024-09-12T02:34:55.343124+0000","last_fullsized":"2024-09-12T02:34:55.343124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:19.174756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.915897+0000","last_change":"2024-09-12T02:34:52.899954+0000","last_active":"2024-09-12T02:34:54.915897+0000","last_peered":"2024-09-12T02:34:54.915897+0000","last_clean":"2024-09-12T02:34:54.915897+0000","last_became_active":"2024-09-12T02:34:52.899233+0000","last_became_peered":"2024-09-12T02:34:52.899233+0000","last_unstale":"2024-09-12T02:34:54.915897+0000","last_undegraded":"2024-09-12T02:34:54.915897+0000","last_fullsized":"2024-09-12T02:34:54.915897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:37.314589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:54.923987+0000","last_change":"2024-09-12T02:34:53.931173+0000","last_active":"2024-09-12T02:34:54.923987+0000","last_peered":"2024-09-12T02:34:54.923987+0000","last_clean":"2024-09-12T02:34:54.923987+0000","last_became_active":"2024-09-12T02:34:53.930915+0000","last_became_peered":"2024-09-12T02:34:53.930915+0000","last_unstale":"2024-09-12T02:34:54.923987+0000","last_undegraded":"2024-09-12T02:34:54.923987+0000","last_fullsized":"2024-09-12T02:34:54.923987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:52.883066+0000","last_clean_scrub_stamp":"2024-09-12T02:34:52.883066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:47.854136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.343052+0000","last_change":"2024-09-12T02:34:52.899556+0000","last_active":"2024-09-12T02:34:55.343052+0000","last_peered":"2024-09-12T02:34:55.343052+0000","last_clean":"2024-09-12T02:34:55.343052+0000","last_became_active":"2024-09-12T02:34:52.899205+0000","last_became_peered":"2024-09-12T02:34:52.899205+0000","last_unstale":"2024-09-12T02:34:55.343052+0000","last_undegraded":"2024-09-12T02:34:55.343052+0000","last_fullsized":"2024-09-12T02:34:55.343052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:51.878505+0000","last_clean_scrub_stamp":"2024-09-12T02:34:51.878505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:46.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T02:34:55.342862+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:34:55.342862+0000","last_peered":"2024-09-12T02:34:55.342862+0000","last_clean":"2024-09-12T02:34:55.342862+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:34:55.342862+0000","last_undegraded":"2024-09-12T02:34:55.342862+0000","last_fullsized":"2024-09-12T02:34:55.342862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":788227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476755,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":196289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":196781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":454656,"data_stored":196759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":454656,"data_stored":196267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":786579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":466944,"data_stored":197823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":454656,"data_stored":196247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:01.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:35:01.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:35:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.786+0000 7f2505274640 1 Processor -- start 2024-09-12T02:35:01.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.786+0000 7f2505274640 1 -- start start 2024-09-12T02:35:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f2505274640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2500162340 0x7f250006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f2505274640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162e30 0x7f25000d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f2505274640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250015ff70 con 0x7f25000cf280 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f2505274640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f250006de90 con 0x7f2500162340 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f2505274640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f25000d4d10 con 0x7f2500162e30 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24feffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2500162340 0x7f250006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24fe7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f25000cf280 0x7f2500162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40612/0 (socket says 172.21.15.119:40612) 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24fe7fc640 1 -- 172.21.15.119:0/502547912 learned_addr learned my addr 172.21.15.119:0/502547912 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162e30 0x7f25000d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24feffd640 1 -- 172.21.15.119:0/502547912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162e30 msgr2=0x7f25000d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24feffd640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162e30 0x7f25000d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24feffd640 1 -- 172.21.15.119:0/502547912 >> v1:172.21.15.119:6789/0 conn(0x7f25000cf280 legacy=0x7f2500162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24feffd640 1 -- 172.21.15.119:0/502547912 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000d4ff0 con 0x7f2500162340 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.787+0000 7f24fdffb640 1 -- 172.21.15.119:0/502547912 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707425818 0 0) 0x7f250015ff70 con 0x7f25000cf280 2024-09-12T02:35:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f24feffd640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162340 0x7f250006d740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097a0 tx=0x7f24f002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bd1d7a50c2a762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f24fdffb640 1 -- 172.21.15.119:0/502547912 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0037070 con 0x7f2500162340 2024-09-12T02:35:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f24fdffb640 1 -- 172.21.15.119:0/502547912 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f002ae50 con 0x7f2500162340 2024-09-12T02:35:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f24fdffb640 1 -- 172.21.15.119:0/502547912 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0032660 con 0x7f2500162340 2024-09-12T02:35:01.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f2505274640 1 -- 172.21.15.119:0/502547912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162340 msgr2=0x7f250006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.788+0000 7f2505274640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162340 0x7f250006d740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097a0 tx=0x7f24f002a100 comp rx=0 tx=0).stop 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 -- 172.21.15.119:0/502547912 shutdown_connections 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162e30 0x7f25000d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 --2- 172.21.15.119:0/502547912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162340 0x7f250006d740 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 -- 172.21.15.119:0/502547912 >> 172.21.15.119:0/502547912 conn(0x7f250008bfc0 msgr2=0x7f25000d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 -- 172.21.15.119:0/502547912 shutdown_connections 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.789+0000 7f2505274640 1 -- 172.21.15.119:0/502547912 wait complete. 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.790+0000 7f2505274640 1 Processor -- start 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.790+0000 7f2505274640 1 -- start start 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000cf280 0x7f2500153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 0x7f25000b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25000cf6c0 con 0x7f2500162e30 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25000d52d0 con 0x7f25000cf280 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f25000d2ed0 con 0x7f2500162340 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42980/0 (socket says 172.21.15.119:42980) 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 -- 172.21.15.119:0/2977972910 learned_addr learned my addr 172.21.15.119:0/2977972910 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24fe7fc640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 0x7f25000b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24feffd640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000cf280 0x7f2500153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 -- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 msgr2=0x7f25000b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 0x7f25000b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 -- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000cf280 msgr2=0x7f2500153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000cf280 0x7f2500153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 -- 172.21.15.119:0/2977972910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000cc260 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24fe7fc640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 0x7f25000b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007e60 tx=0x7f24f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8014420 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f8019070 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8014820 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25000cc540 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.791+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25000cd240 con 0x7f2500162e30 2024-09-12T02:35:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.792+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25000d2990 con 0x7f2500162e30 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.793+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24f80149c0 con 0x7f2500162e30 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.793+0000 7f24e77fe640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.793+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f24f808b7a0 con 0x7f2500162e30 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.793+0000 7f24feffd640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.794+0000 7f24feffd640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 0x7f24ec06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f24f0034000 tx=0x7f24f002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:01.797+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24f805a050 con 0x7f2500162e30 2024-09-12T02:35:02.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.031+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f250008e640 con 0x7f2500162e30 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.033+0000 7f24e77fe640 1 -- 172.21.15.119:0/2977972910 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f24f8059950 con 0x7f2500162e30 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeUuJmPVgaDBAAWRowUlPoFE58xP7z/Jaokg== 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: caps mds = "allow" 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: caps mon = "allow r" 2024-09-12T02:35:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:35:02.035 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2024-09-12T02:35:02.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 msgr2=0x7f24ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 0x7f24ec06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f24f0034000 tx=0x7f24f002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 msgr2=0x7f25000b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007e60 tx=0x7f24f800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 shutdown_connections 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500162e30 0x7f25000b18a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2500162340 0x7f25000b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 --2- 172.21.15.119:0/2977972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000cf280 0x7f2500153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.035+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 >> 172.21.15.119:0/2977972910 conn(0x7f250008bfc0 msgr2=0x7f2500160a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.036+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 shutdown_connections 2024-09-12T02:35:02.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.036+0000 7f2505274640 1 -- 172.21.15.119:0/2977972910 wait complete. 2024-09-12T02:35:02.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:02.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.145+0000 7fd83f83c640 1 Processor -- start 2024-09-12T02:35:02.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.145+0000 7fd83f83c640 1 -- start start 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83f83c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd83815e740 0x7fd8380d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83f83c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd83809b690 0x7fd83806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83f83c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8380d0780 con 0x7fd83806d4c0 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83f83c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd83815eb20 con 0x7fd83809b690 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83f83c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd83806d260 con 0x7fd83815e740 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd83809b690 0x7fd83806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83ddd9640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd83806d4c0 0x7fd83806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40626/0 (socket says 172.21.15.119:40626) 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd83809b690 0x7fd83806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42994/0 (socket says 172.21.15.119:42994) 2024-09-12T02:35:02.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83ddd9640 1 -- 172.21.15.119:0/3318560859 learned_addr learned my addr 172.21.15.119:0/3318560859 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3318560859 >> v2:172.21.15.153:3300/0 conn(0x7fd83815e740 msgr2=0x7fd8380d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83d5d8640 1 --2- 172.21.15.119:0/3318560859 >> v2:172.21.15.153:3300/0 conn(0x7fd83815e740 0x7fd8380d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 --2- 172.21.15.119:0/3318560859 >> v2:172.21.15.153:3300/0 conn(0x7fd83815e740 0x7fd8380d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3318560859 >> v1:172.21.15.119:6789/0 conn(0x7fd83806d4c0 legacy=0x7fd83806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd82ffff640 1 -- 172.21.15.119:0/3318560859 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663593902 0 0) 0x7fd8380d0780 con 0x7fd83806d4c0 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.146+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3318560859 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8380d0a60 con 0x7fd83809b690 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.147+0000 7fd83cdd7640 1 --2- 172.21.15.119:0/3318560859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd83806cd20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd838074070 tx=0x7fd82802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864ddb56a9c0ffcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.147+0000 7fd82ffff640 1 -- 172.21.15.119:0/3318560859 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828037070 con 0x7fd83809b690 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.147+0000 7fd82ffff640 1 -- 172.21.15.119:0/3318560859 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd828032440 con 0x7fd83809b690 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.147+0000 7fd82ffff640 1 -- 172.21.15.119:0/3318560859 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828032810 con 0x7fd83809b690 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 -- 172.21.15.119:0/3318560859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 msgr2=0x7fd83806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3318560859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd83806cd20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd838074070 tx=0x7fd82802a230 comp rx=0 tx=0).stop 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 -- 172.21.15.119:0/3318560859 shutdown_connections 2024-09-12T02:35:02.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3318560859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd83806cd20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3318560859 >> v2:172.21.15.153:3300/0 conn(0x7fd83815e740 0x7fd8380d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 -- 172.21.15.119:0/3318560859 >> 172.21.15.119:0/3318560859 conn(0x7fd8380d23a0 msgr2=0x7fd8380d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 -- 172.21.15.119:0/3318560859 shutdown_connections 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.148+0000 7fd83f83c640 1 -- 172.21.15.119:0/3318560859 wait complete. 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.149+0000 7fd83f83c640 1 Processor -- start 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.149+0000 7fd83f83c640 1 -- start start 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 0x7fd8381f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd83815e740 0x7fd838071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd83809bac0 con 0x7fd83809b690 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd8380d1020 con 0x7fd83815e740 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd83806dfe0 con 0x7fd83806d4c0 2024-09-12T02:35:02.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43008/0 (socket says 172.21.15.119:43008) 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3663419959 learned_addr learned my addr 172.21.15.119:0/3663419959 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83ddd9640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd83815e740 0x7fd838071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83d5d8640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 0x7fd8381f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 msgr2=0x7fd8381f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 0x7fd8381f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd83815e740 msgr2=0x7fd838071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd83815e740 0x7fd838071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 -- 172.21.15.119:0/3663419959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8380c9470 con 0x7fd83809b690 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83d5d8640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 0x7fd8381f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83cdd7640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828037040 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd828042070 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8380c9750 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.150+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828030a50 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.151+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8380c9d10 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.152+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8380d0780 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.152+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd828030bf0 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.152+0000 7fd82dffb640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.153+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd8280ab9d0 con 0x7fd83809b690 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.153+0000 7fd83d5d8640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.153+0000 7fd83d5d8640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd83400a9d0 tx=0x7fd834008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.157+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd82807a1f0 con 0x7fd83809b690 2024-09-12T02:35:02.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.360+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8380d1cb0 con 0x7fd83809b690 2024-09-12T02:35:02.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.361+0000 7fd82dffb640 1 -- 172.21.15.119:0/3663419959 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7fd828079af0 con 0x7fd83809b690 2024-09-12T02:35:02.362 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:02.362 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:02.362 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 msgr2=0x7fd81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd83400a9d0 tx=0x7fd834008040 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 msgr2=0x7fd838070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd8280046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 shutdown_connections 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd83815e740 0x7fd838071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd83809b690 0x7fd838070dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 --2- 172.21.15.119:0/3663419959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd83806d4c0 0x7fd8381f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 >> 172.21.15.119:0/3663419959 conn(0x7fd8380d23a0 msgr2=0x7fd838070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 shutdown_connections 2024-09-12T02:35:02.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.363+0000 7fd83f83c640 1 -- 172.21.15.119:0/3663419959 wait complete. 2024-09-12T02:35:02.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:34:53.232474+0000', 'modified': '2024-09-12T02:34:55.245124+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4851}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4851': {'gid': 4851, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/3594830331', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 3594830331}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3594830331}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4851, 'qdb_cluster': [4851]} 2024-09-12T02:35:02.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:35:02.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.882+0000 7f765aac9640 1 Processor -- start 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.882+0000 7f765aac9640 1 -- start start 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f765aac9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76540b0180 0x7f7654162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f765aac9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f765415eb60 con 0x7f76540af280 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f765aac9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f765415ee40 con 0x7f76540b69d0 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f765aac9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f76540b6db0 con 0x7f76540b0180 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f7659066640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f76540af280 0x7f7654154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40630/0 (socket says 172.21.15.119:40630) 2024-09-12T02:35:02.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.883+0000 7f7659066640 1 -- 172.21.15.119:0/2764957974 learned_addr learned my addr 172.21.15.119:0/2764957974 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7653fff640 1 --2- 172.21.15.119:0/2764957974 >> v2:172.21.15.153:3300/0 conn(0x7f76540b0180 0x7f7654162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099492381 0 0) 0x7f765415eb60 con 0x7f76540af280 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f763c003520 con 0x7f76540af280 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065579863 0 0) 0x7f763c003520 con 0x7f76540af280 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 >> v2:172.21.15.153:3300/0 conn(0x7f76540b0180 msgr2=0x7f7654162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 --2- 172.21.15.119:0/2764957974 >> v2:172.21.15.153:3300/0 conn(0x7f76540b0180 0x7f7654162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 >> v1:172.21.15.153:6789/0 conn(0x7f76540b69d0 legacy=0x7f76540afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765415f120 con 0x7f76540af280 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f764c0019f0 con 0x7f76540af280 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 >> v1:172.21.15.119:6789/0 conn(0x7f76540af280 legacy=0x7f7654154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f763c0039b0 0x7f763c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f763c004800 0x7f763c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f763c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76540b6db0 con 0x7f763c0052e0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f763c00c1b0 con 0x7f763c0039b0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f763c00c3b0 con 0x7f763c004800 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f763c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7658865640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f763c0039b0 0x7f763c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7653fff640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f763c004800 0x7f763c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 -- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f763c004800 msgr2=0x7f763c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f763c004800 0x7f763c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 -- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f763c0039b0 msgr2=0x7f763c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f763c0039b0 0x7f763c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.884+0000 7f7659066640 1 -- 172.21.15.119:0/2764957974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c003520 con 0x7f763c0052e0 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.885+0000 7f7659066640 1 -- 172.21.15.119:0/2764957974 reap_dead start 2024-09-12T02:35:02.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.885+0000 7f7659066640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f763c00b9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f764c00a810 tx=0x7f763c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20aef6a0faf3675 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.885+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00a460 con 0x7f763c0052e0 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.885+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c02f070 con 0x7f763c0052e0 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.885+0000 7f76537fe640 1 -- 172.21.15.119:0/2764957974 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c02bc90 con 0x7f763c0052e0 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 -- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 msgr2=0x7f763c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f763c00b9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f764c00a810 tx=0x7f763c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 -- 172.21.15.119:0/2764957974 shutdown_connections 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 --2- 172.21.15.119:0/2764957974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f763c00b9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 -- 172.21.15.119:0/2764957974 >> 172.21.15.119:0/2764957974 conn(0x7f765406bc10 msgr2=0x7f765406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 -- 172.21.15.119:0/2764957974 shutdown_connections 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.886+0000 7f765aac9640 1 -- 172.21.15.119:0/2764957974 wait complete. 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.887+0000 7f765aac9640 1 Processor -- start 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.887+0000 7f765aac9640 1 -- start start 2024-09-12T02:35:02.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 0x7f7654155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765415b410 0x7f765415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7654162a50 con 0x7f763c0052e0 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76540af6d0 con 0x7f76540ccbb0 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7654162bd0 con 0x7f765415b410 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43024/0 (socket says 172.21.15.119:43024) 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 -- 172.21.15.119:0/1573530943 learned_addr learned my addr 172.21.15.119:0/1573530943 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7653fff640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 0x7f7654155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7659066640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765415b410 0x7f765415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 -- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765415b410 msgr2=0x7f765415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765415b410 0x7f765415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 -- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 msgr2=0x7f7654155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 0x7f7654155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 -- 172.21.15.119:0/1573530943 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7654158dd0 con 0x7f763c0052e0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7653fff640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 0x7f7654155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f7658865640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f764400f650 tx=0x7f764400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f76517fa640 1 -- 172.21.15.119:0/1573530943 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440050d0 con 0x7f763c0052e0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f76517fa640 1 -- 172.21.15.119:0/1573530943 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644018070 con 0x7f763c0052e0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76541590b0 con 0x7f763c0052e0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.888+0000 7f76517fa640 1 -- 172.21.15.119:0/1573530943 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644005490 con 0x7f763c0052e0 2024-09-12T02:35:02.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.889+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7654159b40 con 0x7f763c0052e0 2024-09-12T02:35:02.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.890+0000 7f76517fa640 1 -- 172.21.15.119:0/1573530943 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f764400d730 con 0x7f763c0052e0 2024-09-12T02:35:02.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.890+0000 7f76517fa640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 0x7f764006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.891+0000 7f7653fff640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 0x7f764006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.891+0000 7f76517fa640 1 -- 172.21.15.119:0/1573530943 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f764408adc0 con 0x7f763c0052e0 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.891+0000 7f7653fff640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 0x7f764006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76540cc420 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.891+0000 7f765d860740 1 Processor -- start 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.891+0000 7f765d860740 1 -- start start 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcd8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc90a80 0x563d6dc936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563d6dbf5520 con 0x563d6dc94a50 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d6db9d3e0 con 0x563d6dc932c0 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563d6dbf14e0 con 0x563d6dc90a80 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43038/0 (socket says 172.21.15.119:43038) 2024-09-12T02:35:02.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 -- 172.21.15.119:0/334448661 learned_addr learned my addr 172.21.15.119:0/334448661 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7658865640 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcd8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7653fff640 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc90a80 0x563d6dc936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 -- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc90a80 msgr2=0x563d6dc936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc90a80 0x563d6dc936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 -- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 msgr2=0x563d6dcd8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcd8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.892+0000 7f7659066640 1 -- 172.21.15.119:0/334448661 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6dbb82f0 con 0x563d6dc94a50 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f7659066640 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f764c02b4e0 tx=0x7f764c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f81b979fd6b7a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f763a7fc640 1 -- 172.21.15.119:0/334448661 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00a4e0 con 0x563d6dc94a50 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f763a7fc640 1 -- 172.21.15.119:0/334448661 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c02f040 con 0x563d6dc94a50 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f763a7fc640 1 -- 172.21.15.119:0/334448661 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0019b0 con 0x563d6dc94a50 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 -- 172.21.15.119:0/334448661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 msgr2=0x563d6dc8d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f764c02b4e0 tx=0x7f764c02d000 comp rx=0 tx=0).stop 2024-09-12T02:35:02.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 -- 172.21.15.119:0/334448661 shutdown_connections 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc8d8b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc90a80 0x563d6dc936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 --2- 172.21.15.119:0/334448661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcd8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 -- 172.21.15.119:0/334448661 >> 172.21.15.119:0/334448661 conn(0x563d6dc8fa80 msgr2=0x563d6dcd7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 -- 172.21.15.119:0/334448661 shutdown_connections 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.893+0000 7f765d860740 1 -- 172.21.15.119:0/334448661 wait complete. 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.894+0000 7f765d860740 1 -- start start 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.894+0000 7f765d860740 1 Processor -- start 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dcbd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 0x563d6dcac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563d6dc8ef20 con 0x563d6dcd40a0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d6db7e450 con 0x563d6dc94a50 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563d6dcd9290 con 0x563d6dc932c0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f765d860740 10 client.0 _ll_register_callbacks cb 0x563d6d907ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43044/0 (socket says 172.21.15.119:43044) 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 -- 172.21.15.119:0/1543977424 learned_addr learned my addr 172.21.15.119:0/1543977424 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7658865640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dcbd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7653fff640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 0x563d6dcac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 -- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 msgr2=0x563d6dcbd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dcbd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 -- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 msgr2=0x563d6dcac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 0x563d6dcac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 -- 172.21.15.119:0/1543977424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6d9082d0 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7658865640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dcbd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7653fff640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 0x563d6dcac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f7659066640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f764c001330 tx=0x7f765415ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2bb45017ea7004 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.895+0000 7f76337fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c047060 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f764c00a4e0 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764c02f040 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f764c04d050 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 10 client.5040 fetch_fsmap learned FSMap version 15 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x563d6d9d26b0 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c02f040 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f764c050020 con 0x563d6dcd40a0 2024-09-12T02:35:02.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 10 client.5040 fetch_fsmap finished waiting for FSMap version 15 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 10 client.5040 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 20 client.5040 populate_metadata read hostname 'smithi119' 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dcec100 0x563d6dcf57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 4 client.5040 mds_command: new command op to 4851 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 --> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6dc02c50 con 0x563d6dcec100 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.896+0000 7f7658865640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dcec100 0x563d6dcf57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.897+0000 7f76337fe640 10 client.5040 ms_handle_connect on v2:172.21.15.153:6833/3594830331 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.897+0000 7f7658865640 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dcec100 0x563d6dcf57b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11a07f04396416e3 server_cookie=ae8a9946e08263c0 in_seq=0 out_seq=0 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.897+0000 7f76337fe640 1 -- 172.21.15.119:0/1543977424 <== mds.0 v2:172.21.15.153:6833/3594830331 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d6dc02c50 con 0x563d6dcec100 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.897+0000 7f76337fe640 10 client.5040 handle_command_reply: tid=0 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.897+0000 7f765d860740 1 client.5040 shutdown 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 msgr2=0x563d6dcd4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f764c001330 tx=0x7f765415ed30 comp rx=0 tx=0).stop 2024-09-12T02:35:02.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 shutdown_connections 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dcec100 0x563d6dcf57b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dcd40a0 0x563d6dcd4500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc94a50 0x563d6dcac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 --2- 172.21.15.119:0/1543977424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dcbd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f76337fe640 0 client.5040 ms_handle_reset on v2:172.21.15.153:6833/3594830331 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 >> 172.21.15.119:0/1543977424 conn(0x563d6dc90a80 msgr2=0x563d6dcd9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 shutdown_connections 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 1 -- 172.21.15.119:0/1543977424 wait complete. 2024-09-12T02:35:02.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.898+0000 7f765d860740 20 client.5040 trim_cache size 0 max 16384 2024-09-12T02:35:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.915+0000 7f765d860740 1 Processor -- start 2024-09-12T02:35:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.915+0000 7f765d860740 1 -- start start 2024-09-12T02:35:02.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcbc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dcd40a0 0x563d6dcab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7654200780 con 0x563d6dc94a50 2024-09-12T02:35:02.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76541ffc60 con 0x563d6dc932c0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7654200130 con 0x563d6dcd40a0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43048/0 (socket says 172.21.15.119:43048) 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 -- 172.21.15.119:0/2936306374 learned_addr learned my addr 172.21.15.119:0/2936306374 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7658865640 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcbc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7659066640 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dcd40a0 0x563d6dcab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 -- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dcd40a0 msgr2=0x563d6dcab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dcd40a0 0x563d6dcab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 -- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 msgr2=0x563d6dcbc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcbc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 -- 172.21.15.119:0/2936306374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6dc92be0 con 0x563d6dc94a50 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7653fff640 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7648012e10 tx=0x7f7648015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8476ec392577d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7639ffb640 1 -- 172.21.15.119:0/2936306374 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648023600 con 0x563d6dc94a50 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7639ffb640 1 -- 172.21.15.119:0/2936306374 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764801b040 con 0x563d6dc94a50 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.916+0000 7f7639ffb640 1 -- 172.21.15.119:0/2936306374 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76480239a0 con 0x563d6dc94a50 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 -- 172.21.15.119:0/2936306374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 msgr2=0x563d6dc91ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7648012e10 tx=0x7f7648015000 comp rx=0 tx=0).stop 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 -- 172.21.15.119:0/2936306374 shutdown_connections 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dcd40a0 0x563d6dcab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dc91ab0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 --2- 172.21.15.119:0/2936306374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dc932c0 0x563d6dcbc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 -- 172.21.15.119:0/2936306374 >> 172.21.15.119:0/2936306374 conn(0x563d6dc90a80 msgr2=0x563d6dc8f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 -- 172.21.15.119:0/2936306374 shutdown_connections 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.917+0000 7f765d860740 1 -- 172.21.15.119:0/2936306374 wait complete. 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.918+0000 7f765d860740 1 -- start start 2024-09-12T02:35:02.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.918+0000 7f765d860740 1 Processor -- start 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dce6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dcd40a0 0x563d6dcbcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563d6dc8ef20 con 0x563d6dc94a50 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d6db7e450 con 0x563d6dcd40a0 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563d6dcd2700 con 0x563d6dc932c0 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 10 client.0 _ll_register_callbacks cb 0x7f7644055180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43062/0 (socket says 172.21.15.119:43062) 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 -- 172.21.15.119:0/2745319672 learned_addr learned my addr 172.21.15.119:0/2745319672 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7658865640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dce6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7659066640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dcd40a0 0x563d6dcbcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 -- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 msgr2=0x563d6dce6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dce6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 -- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dcd40a0 msgr2=0x563d6dcbcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dcd40a0 0x563d6dcbcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 -- 172.21.15.119:0/2745319672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6dcebf00 con 0x563d6dc94a50 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f7653fff640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7648027000 tx=0x7f7648004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42337ee27cd1df7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f76337fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764803a060 con 0x563d6dc94a50 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f7648012e40 con 0x563d6dc94a50 2024-09-12T02:35:02.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764801b040 con 0x563d6dc94a50 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f7648040050 con 0x563d6dc94a50 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 10 client.5046 fetch_fsmap learned FSMap version 15 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.919+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x563d6dd57520 con 0x563d6dc94a50 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764801b040 con 0x563d6dc94a50 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f7648043020 con 0x563d6dc94a50 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 10 client.5046 fetch_fsmap finished waiting for FSMap version 15 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 10 client.5046 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 20 client.5046 populate_metadata read hostname 'smithi119' 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dd55f90 0x563d6dd56370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 4 client.5046 mds_command: new command op to 4851 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 --> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] -- command(tid 0: {"prefix": "status"}) -- 0x563d6dbfcfa0 con 0x563d6dd55f90 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f7658865640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dd55f90 0x563d6dd56370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f76337fe640 10 client.5046 ms_handle_connect on v2:172.21.15.153:6833/3594830331 2024-09-12T02:35:02.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.920+0000 7f7658865640 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dd55f90 0x563d6dd56370 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=706517c3b863a48b server_cookie=8af9bd60f81bbb23 in_seq=0 out_seq=0 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f76337fe640 1 -- 172.21.15.119:0/2745319672 <== mds.0 v2:172.21.15.153:6833/3594830331 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563d6dbfcfa0 con 0x563d6dd55f90 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f76337fe640 10 client.5046 handle_command_reply: tid=0 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 client.5046 shutdown 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 msgr2=0x563d6dce6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7648027000 tx=0x7f7648004730 comp rx=0 tx=0).stop 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 shutdown_connections 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:6833/3594830331,v1:172.21.15.153:6835/3594830331] conn(0x563d6dd55f90 0x563d6dd56370 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d6dcd40a0 0x563d6dcbcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563d6dc94a50 0x563d6dce6ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f76337fe640 0 client.5046 ms_handle_reset on v2:172.21.15.153:6833/3594830331 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 --2- 172.21.15.119:0/2745319672 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563d6dc932c0 0x563d6dce6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 >> 172.21.15.119:0/2745319672 conn(0x563d6dc90a80 msgr2=0x563d6dc91ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 shutdown_connections 2024-09-12T02:35:02.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 1 -- 172.21.15.119:0/2745319672 wait complete. 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765d860740 20 client.5046 trim_cache size 0 max 16384 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "3a2846d1-7a08-4c1c-a77f-ac792ab98e22", 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4851, 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-09-12T02:35:02.928 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 9.0115498229999993, 2024-09-12T02:35:02.929 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 15, 2024-09-12T02:35:02.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 40, 2024-09-12T02:35:02.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 40, 2024-09-12T02:35:02.929 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 15.972953085 2024-09-12T02:35:02.929 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 msgr2=0x7f764006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 0x7f764006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76540cc420 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 msgr2=0x7f76540ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f764400f650 tx=0x7f764400fb10 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 shutdown_connections 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f764006be30 0x7f764006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765415b410 0x7f765415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76540ccbb0 0x7f7654155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 --2- 172.21.15.119:0/1573530943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0052e0 0x7f76540ce5c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.921+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 >> 172.21.15.119:0/1573530943 conn(0x7f765406bc10 msgr2=0x7f76540ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.922+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 shutdown_connections 2024-09-12T02:35:02.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:02.922+0000 7f765aac9640 1 -- 172.21.15.119:0/1573530943 wait complete. 2024-09-12T02:35:02.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:35:03.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.029+0000 7fa3e8053640 1 Processor -- start 2024-09-12T02:35:03.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.029+0000 7fa3e8053640 1 -- start start 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e8053640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e00d0be0 0x7fa3e00cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e8053640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e015d460 0x7fa3e00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e8053640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e00af720 con 0x7fa3e0145e00 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e8053640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e01461e0 con 0x7fa3e015d460 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e8053640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e00cdf90 con 0x7fa3e00d0be0 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e65f0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e015d460 0x7fa3e00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e5def640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa3e0145e00 0x7fa3e00d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40642/0 (socket says 172.21.15.119:40642) 2024-09-12T02:35:03.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e5def640 1 -- 172.21.15.119:0/1627661084 learned_addr learned my addr 172.21.15.119:0/1627661084 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:03.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e65f0640 1 -- 172.21.15.119:0/1627661084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e00d0be0 msgr2=0x7fa3e00cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:03.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e65f0640 1 --2- 172.21.15.119:0/1627661084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e00d0be0 0x7fa3e00cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e65f0640 1 -- 172.21.15.119:0/1627661084 >> v1:172.21.15.119:6789/0 conn(0x7fa3e0145e00 legacy=0x7fa3e00d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e4ded640 1 -- 172.21.15.119:0/1627661084 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262989782 0 0) 0x7fa3e00af720 con 0x7fa3e0145e00 2024-09-12T02:35:03.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.030+0000 7fa3e65f0640 1 -- 172.21.15.119:0/1627661084 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e00ce270 con 0x7fa3e015d460 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.031+0000 7fa3e65f0640 1 --2- 172.21.15.119:0/1627661084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00afc00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc06c918d2e1c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.031+0000 7fa3e4ded640 1 -- 172.21.15.119:0/1627661084 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8007740 con 0x7fa3e015d460 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.031+0000 7fa3e4ded640 1 -- 172.21.15.119:0/1627661084 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d80078e0 con 0x7fa3e015d460 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.031+0000 7fa3e4ded640 1 -- 172.21.15.119:0/1627661084 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8007cb0 con 0x7fa3e015d460 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 -- 172.21.15.119:0/1627661084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 msgr2=0x7fa3e00afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 --2- 172.21.15.119:0/1627661084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00afc00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d802a660 comp rx=0 tx=0).stop 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 -- 172.21.15.119:0/1627661084 shutdown_connections 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 --2- 172.21.15.119:0/1627661084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00afc00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 --2- 172.21.15.119:0/1627661084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e00d0be0 0x7fa3e00cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 -- 172.21.15.119:0/1627661084 >> 172.21.15.119:0/1627661084 conn(0x7fa3e00b2f40 msgr2=0x7fa3e00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 -- 172.21.15.119:0/1627661084 shutdown_connections 2024-09-12T02:35:03.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.032+0000 7fa3e8053640 1 -- 172.21.15.119:0/1627661084 wait complete. 2024-09-12T02:35:03.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.033+0000 7fa3e8053640 1 Processor -- start 2024-09-12T02:35:03.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.033+0000 7fa3e8053640 1 -- start start 2024-09-12T02:35:03.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 0x7fa3e009b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 0x7fa3e009ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e015d8b0 con 0x7fa3e015d460 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e00ce830 con 0x7fa3e00d0be0 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e8053640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e00cede0 con 0x7fa3e0145e00 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43084/0 (socket says 172.21.15.119:43084) 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 -- 172.21.15.119:0/3148333884 learned_addr learned my addr 172.21.15.119:0/3148333884 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e5def640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 0x7fa3e009b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e55ee640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 0x7fa3e009ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 -- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 msgr2=0x7fa3e009ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 0x7fa3e009ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 -- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 msgr2=0x7fa3e009b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 0x7fa3e009b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 -- 172.21.15.119:0/3148333884 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0141490 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e5def640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 0x7fa3e009b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e55ee640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 0x7fa3e009ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3e65f0640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009eb0 tx=0x7fa3d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.034+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8040070 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.035+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8031c40 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.035+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e0141770 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.035+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8003990 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.035+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e01426e0 con 0x7fa3e015d460 2024-09-12T02:35:03.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.035+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e00ae4a0 con 0x7fa3e015d460 2024-09-12T02:35:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.036+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3d8039040 con 0x7fa3e015d460 2024-09-12T02:35:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.036+0000 7fa3d67fc640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.037+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa3d80abe70 con 0x7fa3e015d460 2024-09-12T02:35:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.037+0000 7fa3e5def640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.037+0000 7fa3e5def640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 0x7fa3c406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007fd0 tx=0x7fa3dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.041+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3e00ae4a0 con 0x7fa3e015d460 2024-09-12T02:35:03.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.240+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa3e00cdd10 con 0x7fa3e015d460 2024-09-12T02:35:03.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.240+0000 7fa3d67fc640 1 -- 172.21.15.119:0/3148333884 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fa3e00cdd10 con 0x7fa3e015d460 2024-09-12T02:35:03.241 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 msgr2=0x7fa3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 0x7fa3c406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007fd0 tx=0x7fa3dc009040 comp rx=0 tx=0).stop 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 msgr2=0x7fa3e00b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009eb0 tx=0x7fa3d8004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 shutdown_connections 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e015d460 0x7fa3e00b1c90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3e0145e00 0x7fa3e009ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 --2- 172.21.15.119:0/3148333884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e00d0be0 0x7fa3e009b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 >> 172.21.15.119:0/3148333884 conn(0x7fa3e00b2f40 msgr2=0x7fa3e013fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 shutdown_connections 2024-09-12T02:35:03.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03.242+0000 7fa3e8053640 1 -- 172.21.15.119:0/3148333884 wait complete. 2024-09-12T02:35:03.253 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:35:03.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:35:03.253 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:35:03.254 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:03.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.254 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-12T02:35:03.270 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:35:03.271 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:03.272 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:35:03.272 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42729sec preferred_lft 42729sec 2024-09-12T02:35:03.272 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:e9:5b:cd:06:04 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::58a9:acff:fe50:724a/64 scope link 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.273 INFO:teuthology.orchestra.run.smithi119.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:e9:5b:cd:06:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::2ce9:5bff:fecd:604/64 scope link 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 56:7f:76:96:fe:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::547f:76ff:fe96:fecf/64 scope link 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:03.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.274 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:35:03.334 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-12T02:35:03.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.335 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-12T02:35:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-12T02:35:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:35:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:35:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:35:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:35:03.393 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-12T02:35:03.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:03.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:03.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.518 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:35:03.533 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:35:03.533 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:35:03.534 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:03.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-12T02:35:03.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:03.599 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:03.654 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:03.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:03.654 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:03.709 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:35:03.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.709 DEBUG:teuthology.orchestra.run.smithi119:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:35:03.792 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:35:03.792 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:35:03.793 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:35:03.801 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:35:03.801 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:35:03.801 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:35:03.801 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:35:03.801 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.119:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-09-12T02:35:03.808 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3a2846d1-7a08-4c1c-a77f-ac792ab98e22" will pass to kernel 2024-09-12T02:35:03.809 INFO:teuthology.orchestra.run.smithi119.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:35:03.809 INFO:teuthology.orchestra.run.smithi119.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:35:03.809 INFO:teuthology.orchestra.run.smithi119.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:35:03.809 INFO:teuthology.orchestra.run.smithi119.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:35:03.809 INFO:teuthology.orchestra.run.smithi119.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:35:03.810 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:35:03.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:03.811 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:03.881 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:35:03.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:35:03.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:03.984 INFO:teuthology.orchestra.run.smithi119.stdout:client5058 2024-09-12T02:35:03.984 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:03.984 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:04.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:04.000 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir mydir) 2024-09-12T02:35:04.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:04.062 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch mydir/alpha) 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> stdin-killer -- python3 -c ' 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> import stat 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir").st_ino) 2024-09-12T02:35:04.119 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-12T02:35:04.224 INFO:teuthology.orchestra.run.smithi119.stdout:1099511627776 2024-09-12T02:35:04.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> stdin-killer -- python3 -c ' 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> import stat 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir/alpha").st_ino) 2024-09-12T02:35:04.234 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi119.stdout:1099511627777 2024-09-12T02:35:04.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:04.347 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:04.347 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:04.403 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:04.403 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:04.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:04.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.601+0000 7f7b1f952640 1 Processor -- start 2024-09-12T02:35:04.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 -- start start 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7b180b43f0 0x7f7b1809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b180b5050 0x7f7b1815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b180b3830 con 0x7f7b1815b340 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7b180b5bd0 con 0x7f7b180b43f0 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1f952640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7b180b5610 con 0x7f7b180b5050 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.602+0000 7f7b1ceed640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7b180b43f0 0x7f7b1809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1d6ee640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7b1815b340 0x7f7b180b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40648/0 (socket says 172.21.15.119:40648) 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1d6ee640 1 -- 172.21.15.119:0/2380714144 learned_addr learned my addr 172.21.15.119:0/2380714144 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1deef640 1 --2- 172.21.15.119:0/2380714144 >> v2:172.21.15.153:3300/0 conn(0x7f7b180b5050 0x7f7b1815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1ceed640 1 -- 172.21.15.119:0/2380714144 >> v2:172.21.15.153:3300/0 conn(0x7f7b180b5050 msgr2=0x7f7b1815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1ceed640 1 --2- 172.21.15.119:0/2380714144 >> v2:172.21.15.153:3300/0 conn(0x7f7b180b5050 0x7f7b1815b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1ceed640 1 -- 172.21.15.119:0/2380714144 >> v1:172.21.15.119:6789/0 conn(0x7f7b1815b340 legacy=0x7f7b180b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b1ceed640 1 -- 172.21.15.119:0/2380714144 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b180b58f0 con 0x7f7b180b43f0 2024-09-12T02:35:04.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.603+0000 7f7b17fff640 1 -- 172.21.15.119:0/2380714144 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839771637 0 0) 0x7f7b180b3830 con 0x7f7b1815b340 2024-09-12T02:35:04.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1ceed640 1 --2- 172.21.15.119:0/2380714144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b1809aa30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b180719c0 tx=0x7f7b0c02c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a639f244b3bbccff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b17fff640 1 -- 172.21.15.119:0/2380714144 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c009540 con 0x7f7b180b43f0 2024-09-12T02:35:04.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b17fff640 1 -- 172.21.15.119:0/2380714144 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0096e0 con 0x7f7b180b43f0 2024-09-12T02:35:04.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b17fff640 1 -- 172.21.15.119:0/2380714144 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c009ab0 con 0x7f7b180b43f0 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 -- 172.21.15.119:0/2380714144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 msgr2=0x7f7b1809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 --2- 172.21.15.119:0/2380714144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b1809aa30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b180719c0 tx=0x7f7b0c02c7f0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 -- 172.21.15.119:0/2380714144 shutdown_connections 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 --2- 172.21.15.119:0/2380714144 >> v2:172.21.15.153:3300/0 conn(0x7f7b180b5050 0x7f7b1815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 --2- 172.21.15.119:0/2380714144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b1809aa30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 -- 172.21.15.119:0/2380714144 >> 172.21.15.119:0/2380714144 conn(0x7f7b18073490 msgr2=0x7f7b180b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.604+0000 7f7b1f952640 1 -- 172.21.15.119:0/2380714144 shutdown_connections 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.605+0000 7f7b1f952640 1 -- 172.21.15.119:0/2380714144 wait complete. 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 Processor -- start 2024-09-12T02:35:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 -- start start 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b180b5050 0x7f7b180cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b1815b340 0x7f7b181574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b180cdb30 con 0x7f7b180b43f0 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1815d8f0 con 0x7f7b180b5050 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1f952640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b180cdcb0 con 0x7f7b1815b340 2024-09-12T02:35:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1d6ee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1d6ee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43092/0 (socket says 172.21.15.119:43092) 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.606+0000 7f7b1d6ee640 1 -- 172.21.15.119:0/1235766597 learned_addr learned my addr 172.21.15.119:0/1235766597 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1ceed640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b180b5050 0x7f7b180cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 -- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b1815b340 msgr2=0x7f7b181574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1deef640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b1815b340 0x7f7b181574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b1815b340 0x7f7b181574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 -- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b180b5050 msgr2=0x7f7b180cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b180b5050 0x7f7b180cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 -- 172.21.15.119:0/1235766597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b181531b0 con 0x7f7b180b43f0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1d6ee640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c430 tx=0x7f7b1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100074e0 con 0x7f7b180b43f0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b100047e0 con 0x7f7b180b43f0 2024-09-12T02:35:04.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b18153490 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10004bd0 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.607+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b18153a50 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.608+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b18153d80 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.609+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b10011070 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.609+0000 7f7b15ffb640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 0x7f7b0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.609+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f7b1008ad20 con 0x7f7b180b43f0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.609+0000 7f7b1ceed640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 0x7f7b0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.610+0000 7f7b1ceed640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 0x7f7b0406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c036000 tx=0x7f7b0c00b000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.614+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b100594b0 con 0x7f7b180b43f0 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.796+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7b1809aa30 con 0x7f7b180b43f0 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.797+0000 7f7b15ffb640 1 -- 172.21.15.119:0/1235766597 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f7b10058db0 con 0x7f7b180b43f0 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 msgr2=0x7f7b0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 0x7f7b0406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c036000 tx=0x7f7b0c00b000 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 msgr2=0x7f7b18142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c430 tx=0x7f7b1000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 shutdown_connections 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7b0406be30 0x7f7b0406e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b1815b340 0x7f7b181574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b180b5050 0x7f7b180cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 --2- 172.21.15.119:0/1235766597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b180b43f0 0x7f7b18142db0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 >> 172.21.15.119:0/1235766597 conn(0x7f7b18073490 msgr2=0x7f7b180b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 shutdown_connections 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.799+0000 7f7b1f952640 1 -- 172.21.15.119:0/1235766597 wait complete. 2024-09-12T02:35:04.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:35:04.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:04.811 DEBUG:teuthology.orchestra.run.smithi119:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:04.872 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:04.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:04.872 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:35:04.893 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-09-12T02:35:04.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.974+0000 7f09c4b70f40 1 Processor -- start 2024-09-12T02:35:04.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 -- start start 2024-09-12T02:35:04.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb51fc6050 0x55fb5206c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb52050080 0x55fb5206cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fb51f94ae0 con 0x55fb51f98350 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb51ee7510 con 0x55fb52050080 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55fb51f94dc0 con 0x55fb51fc6050 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c2666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c2666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43106/0 (socket says 172.21.15.119:43106) 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c2666640 1 -- 172.21.15.119:0/1770526494 learned_addr learned my addr 172.21.15.119:0/1770526494 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09bbfff640 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb51fc6050 0x55fb5206c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.975+0000 7f09c2e67640 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb52050080 0x55fb5206cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 -- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb51fc6050 msgr2=0x55fb5206c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb51fc6050 0x55fb5206c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 -- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb52050080 msgr2=0x55fb5206cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb52050080 0x55fb5206cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 -- 172.21.15.119:0/1770526494 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb51fd9bd0 con 0x55fb51f98350 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c2666640 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f09b400a4f0 tx=0x7f09b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164972c606f79cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c1664640 1 -- 172.21.15.119:0/1770526494 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b400a220 con 0x55fb51f98350 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c1664640 1 -- 172.21.15.119:0/1770526494 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b4052930 con 0x55fb51f98350 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c1664640 1 -- 172.21.15.119:0/1770526494 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4052d20 con 0x55fb51f98350 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1770526494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 msgr2=0x55fb51fc5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f09b400a4f0 tx=0x7f09b4051000 comp rx=0 tx=0).stop 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1770526494 shutdown_connections 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb52050080 0x55fb5206cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb51fc6050 0x55fb5206c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1770526494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb51fc5250 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.976+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1770526494 >> 172.21.15.119:0/1770526494 conn(0x55fb51f959e0 msgr2=0x55fb51f93e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.977+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1770526494 shutdown_connections 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.977+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1770526494 wait complete. 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.977+0000 7f09c4b70f40 1 Processor -- start 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.977+0000 7f09c4b70f40 1 -- start start 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb52067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb51fc6050 0x55fb5204a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb52050080 0x55fb5204a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fb51f97d90 con 0x55fb51f98350 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb51fdba50 con 0x55fb51fc6050 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c4b70f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55fb51f97f10 con 0x55fb52050080 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb52067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb52067a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43108/0 (socket says 172.21.15.119:43108) 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 -- 172.21.15.119:0/1378800510 learned_addr learned my addr 172.21.15.119:0/1378800510 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09bbfff640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb51fc6050 0x55fb5204a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2e67640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb52050080 0x55fb5204a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 -- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb52050080 msgr2=0x55fb5204a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb52050080 0x55fb5204a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 -- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb51fc6050 msgr2=0x55fb5204a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb51fc6050 0x55fb5204a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 -- 172.21.15.119:0/1378800510 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5204af60 con 0x55fb51f98350 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2e67640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fb52050080 0x55fb5204a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.978+0000 7f09c2666640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb52067a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f09b4025cc0 tx=0x7f09b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.979+0000 7f09bb7fe640 1 -- 172.21.15.119:0/1378800510 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4072020 con 0x55fb51f98350 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.979+0000 7f09bb7fe640 1 -- 172.21.15.119:0/1378800510 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b4052ae0 con 0x55fb51f98350 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.979+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb5204b240 con 0x55fb51f98350 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.979+0000 7f09bb7fe640 1 -- 172.21.15.119:0/1378800510 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b406e450 con 0x55fb51f98350 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.979+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb52056990 con 0x55fb51f98350 2024-09-12T02:35:04.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.980+0000 7f09bb7fe640 1 -- 172.21.15.119:0/1378800510 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09b4075020 con 0x55fb51f98350 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.980+0000 7f09bb7fe640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f09a406a810 0x7f09a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09bb7fe640 1 -- 172.21.15.119:0/1378800510 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f09b40cedf0 con 0x55fb51f98350 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09bbfff640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f09a406a810 0x7f09a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x55fb520fc2e0 0x55fb520fc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55fb520fcc60 con 0x55fb520fc2e0 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09bbfff640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f09a406a810 0x7f09a406ccd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55fb51fc2210 tx=0x7f09ac0018a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.981+0000 7f09c2e67640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x55fb520fc2e0 0x55fb520fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c2e67640 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x55fb520fc2e0 0x55fb520fc720 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c2e67640 1 -- 172.21.15.119:0/1378800510 <== osd.7 v2:172.21.15.153:6816/3440899718 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f09bc011040 con 0x55fb520fc2e0 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x55fb520fc2e0 msgr2=0x55fb520fc720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x55fb520fc2e0 0x55fb520fc720 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f09a406a810 msgr2=0x7f09a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f09a406a810 0x7f09a406ccd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55fb51fc2210 tx=0x7f09ac0018a0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 msgr2=0x55fb52067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 --2- 172.21.15.119:0/1378800510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb51f98350 0x55fb52067a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f09b4025cc0 tx=0x7f09b4002fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c2e67640 1 -- 172.21.15.119:0/1378800510 reap_dead start 2024-09-12T02:35:04.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 shutdown_connections 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 >> 172.21.15.119:0/1378800510 conn(0x55fb51f959e0 msgr2=0x55fb51fc5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 shutdown_connections 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:04.982+0000 7f09c4b70f40 1 -- 172.21.15.119:0/1378800510 wait complete. 2024-09-12T02:35:04.988 ERROR:tasks.cephfs.filesystem:Command failed on smithi119 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-09-12T02:35:04.988 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-12T02:35:05.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.070+0000 7fc71fa44f40 1 Processor -- start 2024-09-12T02:35:05.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.070+0000 7fc71fa44f40 1 -- start start 2024-09-12T02:35:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 0x55b45c3ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c502340 0x55b45c3cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b45c3e9f20 con 0x55b45c3ccf40 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b45c2f4510 con 0x55b45c502340 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b45c3ea4a0 con 0x55b45c47b240 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43122/0 (socket says 172.21.15.119:43122) 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 -- 172.21.15.119:0/566628180 learned_addr learned my addr 172.21.15.119:0/566628180 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71dd3b640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c502340 0x55b45c3cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc717fff640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 0x55b45c3ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 -- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 msgr2=0x55b45c3ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 0x55b45c3ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 -- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c502340 msgr2=0x55b45c3cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c502340 0x55b45c3cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 -- 172.21.15.119:0/566628180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45c46ee50 con 0x55b45c3ccf40 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc717fff640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 0x55b45c3ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.071+0000 7fc71d53a640 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc710009750 tx=0x7fc710005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8b35db28cff23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc7177fe640 1 -- 172.21.15.119:0/566628180 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710019070 con 0x55b45c3ccf40 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc7177fe640 1 -- 172.21.15.119:0/566628180 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc710008890 con 0x55b45c3ccf40 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc7177fe640 1 -- 172.21.15.119:0/566628180 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710008c60 con 0x55b45c3ccf40 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 -- 172.21.15.119:0/566628180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 msgr2=0x55b45c46f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc710009750 tx=0x7fc710005a00 comp rx=0 tx=0).stop 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 -- 172.21.15.119:0/566628180 shutdown_connections 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c502340 0x55b45c3cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c47b240 0x55b45c3ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/566628180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c3ccf40 0x55b45c46f190 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 -- 172.21.15.119:0/566628180 >> 172.21.15.119:0/566628180 conn(0x55b45c3a29e0 msgr2=0x55b45c3ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 -- 172.21.15.119:0/566628180 shutdown_connections 2024-09-12T02:35:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.072+0000 7fc71fa44f40 1 -- 172.21.15.119:0/566628180 wait complete. 2024-09-12T02:35:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 Processor -- start 2024-09-12T02:35:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 -- start start 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c3ccf40 0x55b45c3e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 0x55b45c3a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c502340 0x55b45c469fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b45c3ce430 con 0x55b45c47b240 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b45c3e88f0 con 0x55b45c3ccf40 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.073+0000 7fc71fa44f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b45c3a5540 con 0x55b45c502340 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 0x55b45c3a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 0x55b45c3a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43128/0 (socket says 172.21.15.119:43128) 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 -- 172.21.15.119:0/2152797902 learned_addr learned my addr 172.21.15.119:0/2152797902 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc71d53a640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c3ccf40 0x55b45c3e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc71dd3b640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c502340 0x55b45c469fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 -- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c502340 msgr2=0x55b45c469fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b45c502340 0x55b45c469fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 -- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c3ccf40 msgr2=0x55b45c3e2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b45c3ccf40 0x55b45c3e2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 -- 172.21.15.119:0/2152797902 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45c3e5b30 con 0x55b45c47b240 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc717fff640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 0x55b45c3a3e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc70800a5a0 tx=0x7fc708002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc7167fc640 1 -- 172.21.15.119:0/2152797902 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70805f860 con 0x55b45c47b240 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc7167fc640 1 -- 172.21.15.119:0/2152797902 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70805fa00 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45c3e3190 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc7167fc640 1 -- 172.21.15.119:0/2152797902 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70805fdf0 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.074+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b45c3e3dd0 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc7167fc640 1 -- 172.21.15.119:0/2152797902 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc708070060 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc7167fc640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc70006a840 0x7fc70006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc7167fc640 1 -- 172.21.15.119:0/2152797902 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc7080cdf20 con 0x55b45c47b240 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc71d53a640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc70006a840 0x7fc70006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55b45c3a4360 0x55b45c3e6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.076+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55b45c477410 con 0x55b45c3a4360 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71d53a640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc70006a840 0x7fc70006cd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc710005a40 tx=0x7fc710008000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71dd3b640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55b45c3a4360 0x55b45c3e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71dd3b640 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55b45c3a4360 0x55b45c3e6520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71dd3b640 1 -- 172.21.15.119:0/2152797902 <== osd.5 v2:172.21.15.153:6824/2972675875 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7fc718002720 con 0x55b45c3a4360 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55b45c3a4360 msgr2=0x55b45c3e6520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55b45c3a4360 0x55b45c3e6520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc70006a840 msgr2=0x7fc70006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc70006a840 0x7fc70006cd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc710005a40 tx=0x7fc710008000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 msgr2=0x55b45c3a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71fa44f40 1 --2- 172.21.15.119:0/2152797902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b45c47b240 0x55b45c3a3e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc70800a5a0 tx=0x7fc708002fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.077+0000 7fc71dd3b640 1 -- 172.21.15.119:0/2152797902 reap_dead start 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.078+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 shutdown_connections 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.078+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 >> 172.21.15.119:0/2152797902 conn(0x55b45c3a29e0 msgr2=0x55b45c46e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.078+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 shutdown_connections 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.078+0000 7fc71fa44f40 1 -- 172.21.15.119:0/2152797902 wait complete. 2024-09-12T02:35:05.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:05.083 ERROR:tasks.cephfs.filesystem:Command failed on smithi119 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-09-12T02:35:05.083 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-12T02:35:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.126+0000 7f9bf4d1bf40 1 Processor -- start 2024-09-12T02:35:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.126+0000 7f9bf4d1bf40 1 -- start start 2024-09-12T02:35:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f73130 0x55ca16edfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 0x55ca16f68c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca16ee36f0 con 0x55ca16ee3a10 2024-09-12T02:35:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ca16ded510 con 0x55ca16f74520 2024-09-12T02:35:05.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ca16ee43b0 con 0x55ca16f73130 2024-09-12T02:35:05.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43138/0 (socket says 172.21.15.119:43138) 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 -- 172.21.15.119:0/1272222455 learned_addr learned my addr 172.21.15.119:0/1272222455 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf3012640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 0x55ca16f68c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 -- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f73130 msgr2=0x55ca16edfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2010640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f73130 0x55ca16edfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f73130 0x55ca16edfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 -- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 msgr2=0x55ca16f68c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 0x55ca16f68c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 -- 172.21.15.119:0/1272222455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca16f6ef00 con 0x55ca16ee3a10 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf3012640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 0x55ca16f68c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.127+0000 7f9bf2811640 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00b240 tx=0x7f9bdc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f315bfdee57c5ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf100e640 1 -- 172.21.15.119:0/1272222455 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc008070 con 0x55ca16ee3a10 2024-09-12T02:35:05.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf100e640 1 -- 172.21.15.119:0/1272222455 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00d500 con 0x55ca16ee3a10 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf100e640 1 -- 172.21.15.119:0/1272222455 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00d8b0 con 0x55ca16ee3a10 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/1272222455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 msgr2=0x55ca16ec6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00b240 tx=0x7f9bdc00b700 comp rx=0 tx=0).stop 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/1272222455 shutdown_connections 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16f74520 0x55ca16f68c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f73130 0x55ca16edfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/1272222455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16ee3a10 0x55ca16ec6560 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/1272222455 >> 172.21.15.119:0/1272222455 conn(0x55ca16e9b9e0 msgr2=0x55ca16ee5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/1272222455 shutdown_connections 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.128+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/1272222455 wait complete. 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.129+0000 7f9bf4d1bf40 1 Processor -- start 2024-09-12T02:35:05.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.129+0000 7f9bf4d1bf40 1 -- start start 2024-09-12T02:35:05.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16ee3a10 0x55ca17009660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 0x55ca16f6db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f74520 0x55ca16f68bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca16ee1930 con 0x55ca16f73130 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ca16ee1bd0 con 0x55ca16ee3a10 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.130+0000 7f9bf4d1bf40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ca16ecb2f0 con 0x55ca16f74520 2024-09-12T02:35:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 0x55ca16f6db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 0x55ca16f6db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43148/0 (socket says 172.21.15.119:43148) 2024-09-12T02:35:05.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 -- 172.21.15.119:0/554965276 learned_addr learned my addr 172.21.15.119:0/554965276 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2811640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16ee3a10 0x55ca17009660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf3012640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f74520 0x55ca16f68bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 -- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f74520 msgr2=0x55ca16f68bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f74520 0x55ca16f68bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 -- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16ee3a10 msgr2=0x55ca17009660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16ee3a10 0x55ca17009660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 -- 172.21.15.119:0/554965276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca16e9a8c0 con 0x55ca16f73130 2024-09-12T02:35:05.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2811640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca16ee3a10 0x55ca17009660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf3012640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ca16f74520 0x55ca16f68bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf2010640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 0x55ca16f6db10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9be4045ef0 tx=0x7f9be4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bebfff640 1 -- 172.21.15.119:0/554965276 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4064070 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bebfff640 1 -- 172.21.15.119:0/554965276 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be4054930 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca16e9aba0 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bebfff640 1 -- 172.21.15.119:0/554965276 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4054ce0 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.131+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca16f6d500 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bebfff640 1 -- 172.21.15.119:0/554965276 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9be4067070 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bebfff640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9bd406a810 0x7f9bd406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bebfff640 1 -- 172.21.15.119:0/554965276 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9be40ce030 con 0x55ca16f73130 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bf2811640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9bd406a810 0x7f9bd406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ca16f6e050 0x55ca1700cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.133+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- osd_op(unknown.0.0:1 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55ca16ee2fc0 con 0x55ca16f6e050 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf2811640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9bd406a810 0x7f9bd406ccd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc008000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf3012640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ca16f6e050 0x55ca1700cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf3012640 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ca16f6e050 0x55ca1700cd10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf3012640 1 -- 172.21.15.119:0/554965276 <== osd.6 v2:172.21.15.153:6808/3269269432 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7f9bec011040 con 0x55ca16f6e050 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ca16f6e050 msgr2=0x55ca1700cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.134+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ca16f6e050 0x55ca1700cd10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9bd406a810 msgr2=0x7f9bd406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f9bd406a810 0x7f9bd406ccd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc008000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 msgr2=0x55ca16f6db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 --2- 172.21.15.119:0/554965276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca16f73130 0x55ca16f6db10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9be4045ef0 tx=0x7f9be4002fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf3012640 1 -- 172.21.15.119:0/554965276 reap_dead start 2024-09-12T02:35:05.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 shutdown_connections 2024-09-12T02:35:05.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 >> 172.21.15.119:0/554965276 conn(0x55ca16e9b9e0 msgr2=0x55ca16ec6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 shutdown_connections 2024-09-12T02:35:05.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.135+0000 7f9bf4d1bf40 1 -- 172.21.15.119:0/554965276 wait complete. 2024-09-12T02:35:05.144 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.278+0000 7f82dfd2a640 1 Processor -- start 2024-09-12T02:35:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.278+0000 7f82dfd2a640 1 -- start start 2024-09-12T02:35:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dfd2a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f82d806e6e0 0x7f82d80b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dfd2a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dfd2a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d806ec10 con 0x7f82d80afde0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dfd2a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f82d806fd60 con 0x7f82d806e6e0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dfd2a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80b01c0 con 0x7f82d80b6420 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dd2c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f82d806e6e0 0x7f82d80b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82ddac6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f82d80afde0 0x7f82d815d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40672/0 (socket says 172.21.15.119:40672) 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82ddac6640 1 -- 172.21.15.119:0/1770984809 learned_addr learned my addr 172.21.15.119:0/1770984809 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dcac4640 1 -- 172.21.15.119:0/1770984809 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022008487 0 0) 0x7f82d806ec10 con 0x7f82d80afde0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82dcac4640 1 -- 172.21.15.119:0/1770984809 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c4003520 con 0x7f82d80afde0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.279+0000 7f82de2c7640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dd2c5640 1 -- 172.21.15.119:0/1770984809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 msgr2=0x7f82d815dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dd2c5640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d815dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dd2c5640 1 -- 172.21.15.119:0/1770984809 >> v1:172.21.15.119:6789/0 conn(0x7f82d80afde0 legacy=0x7f82d815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dd2c5640 1 -- 172.21.15.119:0/1770984809 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d806eef0 con 0x7f82d806e6e0 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dd2c5640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d806e6e0 0x7f82d80b5ee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82d40097a0 tx=0x7f82d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2c271932c8270e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dcac4640 1 -- 172.21.15.119:0/1770984809 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4037070 con 0x7f82d806e6e0 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dcac4640 1 -- 172.21.15.119:0/1770984809 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4032440 con 0x7f82d806e6e0 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.280+0000 7f82dcac4640 1 -- 172.21.15.119:0/1770984809 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4032810 con 0x7f82d806e6e0 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 -- 172.21.15.119:0/1770984809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d806e6e0 msgr2=0x7f82d80b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d806e6e0 0x7f82d80b5ee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82d40097a0 tx=0x7f82d402a180 comp rx=0 tx=0).stop 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 -- 172.21.15.119:0/1770984809 shutdown_connections 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d815dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/1770984809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d806e6e0 0x7f82d80b5ee0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 -- 172.21.15.119:0/1770984809 >> 172.21.15.119:0/1770984809 conn(0x7f82d806bc10 msgr2=0x7f82d806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 -- 172.21.15.119:0/1770984809 shutdown_connections 2024-09-12T02:35:05.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.281+0000 7f82dfd2a640 1 -- 172.21.15.119:0/1770984809 wait complete. 2024-09-12T02:35:05.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.282+0000 7f82dfd2a640 1 Processor -- start 2024-09-12T02:35:05.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.282+0000 7f82dfd2a640 1 -- start start 2024-09-12T02:35:05.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 0x7f82d80a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d81f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806f4b0 con 0x7f82d80afde0 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82d80b6850 con 0x7f82d806e6e0 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dfd2a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82d806f790 con 0x7f82d80b6420 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43174/0 (socket says 172.21.15.119:43174) 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 -- 172.21.15.119:0/3497133905 learned_addr learned my addr 172.21.15.119:0/3497133905 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82de2c7640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d81f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82ddac6640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 0x7f82d80a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 -- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 msgr2=0x7f82d81f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d81f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 -- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 msgr2=0x7f82d80a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 0x7f82d80a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82dd2c5640 1 -- 172.21.15.119:0/3497133905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d80aa810 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82de2c7640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.283+0000 7f82ddac6640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 0x7f82d80a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82dd2c5640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f82d402a1c0 tx=0x7f82d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4041020 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4030700 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d80aaaf0 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4037040 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.284+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d80ab0b0 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.285+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80af620 con 0x7f82d80afde0 2024-09-12T02:35:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.285+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82d4044020 con 0x7f82d80afde0 2024-09-12T02:35:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.286+0000 7f82ce7fc640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 0x7f82bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.286+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f82d40ab830 con 0x7f82d80afde0 2024-09-12T02:35:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.286+0000 7f82ddac6640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 0x7f82bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.286+0000 7f82ddac6640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 0x7f82bc06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82c8007fd0 tx=0x7f82c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.290+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82d404b030 con 0x7f82d80afde0 2024-09-12T02:35:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.496+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82d815e6d0 con 0x7f82d80afde0 2024-09-12T02:35:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.497+0000 7f82ce7fc640 1 -- 172.21.15.119:0/3497133905 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f82d407a050 con 0x7f82d80afde0 2024-09-12T02:35:05.498 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:05.498 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:05.498 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:05.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 msgr2=0x7f82bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 0x7f82bc06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82c8007fd0 tx=0x7f82c8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 msgr2=0x7f82d81f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f82d402a1c0 tx=0x7f82d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 shutdown_connections 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f82bc06be30 0x7f82bc06e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d80b6420 0x7f82d81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d80afde0 0x7f82d81f5380 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 --2- 172.21.15.119:0/3497133905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d806e6e0 0x7f82d80a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 >> 172.21.15.119:0/3497133905 conn(0x7f82d806bc10 msgr2=0x7f82d815db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 shutdown_connections 2024-09-12T02:35:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.499+0000 7f82dfd2a640 1 -- 172.21.15.119:0/3497133905 wait complete. 2024-09-12T02:35:05.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-12T02:35:05.653 INFO:teuthology.orchestra.run.smithi153.stdout:{"message":"","return_code":0} 2024-09-12T02:35:05.654 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:35:05.654 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-09-12T02:35:05.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.696+0000 7f882111ef40 1 Processor -- start 2024-09-12T02:35:05.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.696+0000 7f882111ef40 1 -- start start 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f880c0030f0 0x5591a51cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 0x5591a51cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5591a5049510 con 0x5591a51c6320 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5591a50a2c50 con 0x5591a5138700 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f882111ef40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5591a51416b0 con 0x7f880c0030f0 2024-09-12T02:35:05.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43182/0 (socket says 172.21.15.119:43182) 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 -- 172.21.15.119:0/1665844208 learned_addr learned my addr 172.21.15.119:0/1665844208 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f881e948640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 0x5591a51cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f881e147640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f880c0030f0 0x5591a51cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 -- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f880c0030f0 msgr2=0x5591a51cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f880c0030f0 0x5591a51cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 -- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 msgr2=0x5591a51cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 0x5591a51cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f8815946640 1 -- 172.21.15.119:0/1665844208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a513ee20 con 0x5591a51c6320 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.697+0000 7f881e948640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 0x5591a51cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f8815946640 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f88080462a0 tx=0x7f880804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8eeea80f7457e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f881d145640 1 -- 172.21.15.119:0/1665844208 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880800a200 con 0x5591a51c6320 2024-09-12T02:35:05.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f881d145640 1 -- 172.21.15.119:0/1665844208 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880800a3c0 con 0x5591a51c6320 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f881d145640 1 -- 172.21.15.119:0/1665844208 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88080579f0 con 0x5591a51c6320 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 -- 172.21.15.119:0/1665844208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 msgr2=0x5591a51c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f88080462a0 tx=0x7f880804f000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 -- 172.21.15.119:0/1665844208 shutdown_connections 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a5138700 0x5591a51cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591a51c6320 0x5591a51c33f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 --2- 172.21.15.119:0/1665844208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f880c0030f0 0x5591a51cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 -- 172.21.15.119:0/1665844208 >> 172.21.15.119:0/1665844208 conn(0x5591a5125490 msgr2=0x5591a50f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 -- 172.21.15.119:0/1665844208 shutdown_connections 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.698+0000 7f882111ef40 1 -- 172.21.15.119:0/1665844208 wait complete. 2024-09-12T02:35:05.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.699+0000 7f882111ef40 1 Processor -- start 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.699+0000 7f882111ef40 1 -- start start 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.699+0000 7f882111ef40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5591a5138700 0x5591a51bb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.699+0000 7f882111ef40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a51c6320 0x5591a51ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.699+0000 7f882111ef40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 0x5591a51c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f882111ef40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5591a51c3cf0 con 0x7f880c0030f0 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f882111ef40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5591a513f090 con 0x5591a51c6320 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f882111ef40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5591a51cc3e0 con 0x5591a5138700 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 0x5591a51c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e147640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5591a5138700 0x5591a51bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 0x5591a51c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43186/0 (socket says 172.21.15.119:43186) 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e147640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5591a5138700 0x5591a51bb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:38506/0 (socket says 172.21.15.119:38506) 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f8815946640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a51c6320 0x5591a51ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 -- 172.21.15.119:0/383304617 learned_addr learned my addr 172.21.15.119:0/383304617 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 -- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5591a5138700 msgr2=0x5591a51bb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5591a5138700 0x5591a51bb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 -- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a51c6320 msgr2=0x5591a51ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591a51c6320 0x5591a51ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 -- 172.21.15.119:0/383304617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a51c45f0 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f881e948640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 0x5591a51c6760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5591a5141d50 tx=0x7f881800f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f8817fff640 1 -- 172.21.15.119:0/383304617 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818014660 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f8817fff640 1 -- 172.21.15.119:0/383304617 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818014800 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591a51c48d0 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f8817fff640 1 -- 172.21.15.119:0/383304617 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818014bd0 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.700+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a51c4e90 con 0x7f880c0030f0 2024-09-12T02:35:05.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f8817fff640 1 -- 172.21.15.119:0/383304617 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8818012070 con 0x7f880c0030f0 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f8817fff640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f880006a840 0x7f880006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f8817fff640 1 -- 172.21.15.119:0/383304617 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8818089dc0 con 0x7f880c0030f0 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f881e147640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f880006a840 0x7f880006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f882111ef40 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x5591a51c4140 0x5591a51bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5591a51bf590 con 0x5591a51c4140 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f881e147640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f880006a840 0x7f880006cd00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8810001200 tx=0x7f8810000ed0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.702+0000 7f8815946640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x5591a51c4140 0x5591a51bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f8815946640 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x5591a51c4140 0x5591a51bf050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f8815946640 1 -- 172.21.15.119:0/383304617 <== osd.7 v2:172.21.15.153:6816/3440899718 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=19b] v0'0 uv10 ondisk = 0) ==== 164+0+19 (crc 0 0 0) 0x7f88080577b0 con 0x5591a51c4140 2024-09-12T02:35:05.709 INFO:teuthology.orchestra.run.smithi119.stdout:alpha_head 2024-09-12T02:35:05.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x5591a51c4140 msgr2=0x5591a51bf050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x5591a51c4140 0x5591a51bf050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f880006a840 msgr2=0x7f880006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f880006a840 0x7f880006cd00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8810001200 tx=0x7f8810000ed0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 msgr2=0x5591a51c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 --2- 172.21.15.119:0/383304617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f880c0030f0 0x5591a51c6760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5591a5141d50 tx=0x7f881800f5b0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f881e948640 1 -- 172.21.15.119:0/383304617 reap_dead start 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 shutdown_connections 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 >> 172.21.15.119:0/383304617 conn(0x5591a5125490 msgr2=0x5591a5140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 shutdown_connections 2024-09-12T02:35:05.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.703+0000 7f882111ef40 1 -- 172.21.15.119:0/383304617 wait complete. 2024-09-12T02:35:05.712 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-12T02:35:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.792+0000 7fb090a7df40 1 Processor -- start 2024-09-12T02:35:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.792+0000 7fb090a7df40 1 -- start start 2024-09-12T02:35:05.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 0x55ad9662c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 0x55ad96637420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ad964b2510 con 0x55ad96635d20 2024-09-12T02:35:05.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad9650bc50 con 0x55ad96636100 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb090a7df40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ad965aa6b0 con 0x55ad965a9640 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43218/0 (socket says 172.21.15.119:43218) 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 -- 172.21.15.119:0/2784581889 learned_addr learned my addr 172.21.15.119:0/2784581889 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08e573640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 0x55ad9662c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08ed74640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 0x55ad96637420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 -- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 msgr2=0x55ad9662c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 0x55ad9662c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 -- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 msgr2=0x55ad96637420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 0x55ad96637420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08dd72640 1 -- 172.21.15.119:0/2784581889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad966395c0 con 0x55ad96635d20 2024-09-12T02:35:05.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08ed74640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 0x55ad96637420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.793+0000 7fb08e573640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 0x55ad9662c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb08dd72640 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb078055040 tx=0x7fb078051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff57889c9a39ac70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb08cd70640 1 -- 172.21.15.119:0/2784581889 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078052d60 con 0x55ad96635d20 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb08cd70640 1 -- 172.21.15.119:0/2784581889 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb078065480 con 0x55ad96635d20 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb08cd70640 1 -- 172.21.15.119:0/2784581889 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078065870 con 0x55ad96635d20 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 -- 172.21.15.119:0/2784581889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 msgr2=0x55ad96636ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb078055040 tx=0x7fb078051000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 -- 172.21.15.119:0/2784581889 shutdown_connections 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96636100 0x55ad96637420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad96635d20 0x55ad96636ee0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 --2- 172.21.15.119:0/2784581889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad965a9640 0x55ad9662c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 -- 172.21.15.119:0/2784581889 >> 172.21.15.119:0/2784581889 conn(0x55ad9658e490 msgr2=0x55ad9658dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 -- 172.21.15.119:0/2784581889 shutdown_connections 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.794+0000 7fb090a7df40 1 -- 172.21.15.119:0/2784581889 wait complete. 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.795+0000 7fb090a7df40 1 Processor -- start 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.795+0000 7fb090a7df40 1 -- start start 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 0x55ad96629010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96635d20 0x55ad965a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad96636100 0x55ad9662ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ad966302b0 con 0x55ad965a9640 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad966364e0 con 0x55ad96635d20 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ad96636730 con 0x55ad96636100 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 0x55ad96629010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 0x55ad96629010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43224/0 (socket says 172.21.15.119:43224) 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 -- 172.21.15.119:0/3762794924 learned_addr learned my addr 172.21.15.119:0/3762794924 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08ed74640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad96636100 0x55ad9662ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08dd72640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96635d20 0x55ad965a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 -- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad96636100 msgr2=0x55ad9662ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad96636100 0x55ad9662ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 -- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96635d20 msgr2=0x55ad965a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad96635d20 0x55ad965a73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 -- 172.21.15.119:0/3762794924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad965a7920 con 0x55ad965a9640 2024-09-12T02:35:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb08e573640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 0x55ad96629010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb08800dfb0 tx=0x7fb08800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb0877fe640 1 -- 172.21.15.119:0/3762794924 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088014020 con 0x55ad965a9640 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb0877fe640 1 -- 172.21.15.119:0/3762794924 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08800be50 con 0x55ad965a9640 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad96590a40 con 0x55ad965a9640 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb0877fe640 1 -- 172.21.15.119:0/3762794924 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088008030 con 0x55ad965a9640 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.796+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad96591000 con 0x55ad965a9640 2024-09-12T02:35:05.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb0877fe640 1 -- 172.21.15.119:0/3762794924 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb088017020 con 0x55ad965a9640 2024-09-12T02:35:05.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb0877fe640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07006a810 0x7fb07006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb0877fe640 1 -- 172.21.15.119:0/3762794924 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb0880898e0 con 0x55ad965a9640 2024-09-12T02:35:05.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb08dd72640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07006a810 0x7fb07006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb090a7df40 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ad9662f2a0 0x55ad966ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.798+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- osd_op(unknown.0.0:1 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55ad9658d6b0 con 0x55ad9662f2a0 2024-09-12T02:35:05.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb08ed74640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ad9662f2a0 0x55ad966ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb08dd72640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07006a810 0x7fb07006ccd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb07805d000 tx=0x7fb078053000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb08ed74640 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ad9662f2a0 0x55ad966ce8c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb08ed74640 1 -- 172.21.15.119:0/3762794924 <== osd.6 v2:172.21.15.153:6808/3269269432 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=19b] v0'0 uv6 ondisk = 0) ==== 154+0+19 (crc 0 0 0) 0x7fb0800106b0 con 0x55ad9662f2a0 2024-09-12T02:35:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:mydir_head 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ad9662f2a0 msgr2=0x55ad966ce8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x55ad9662f2a0 0x55ad966ce8c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07006a810 msgr2=0x7fb07006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07006a810 0x7fb07006ccd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb07805d000 tx=0x7fb078053000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 msgr2=0x55ad96629010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 --2- 172.21.15.119:0/3762794924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad965a9640 0x55ad96629010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb08800dfb0 tx=0x7fb08800b6a0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb08ed74640 1 -- 172.21.15.119:0/3762794924 reap_dead start 2024-09-12T02:35:05.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 shutdown_connections 2024-09-12T02:35:05.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 >> 172.21.15.119:0/3762794924 conn(0x55ad9658e490 msgr2=0x55ad9655ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 shutdown_connections 2024-09-12T02:35:05.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.799+0000 7fb090a7df40 1 -- 172.21.15.119:0/3762794924 wait complete. 2024-09-12T02:35:05.808 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-12T02:35:05.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.890+0000 7f5bcfa20f40 1 Processor -- start 2024-09-12T02:35:05.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.890+0000 7f5bcfa20f40 1 -- start start 2024-09-12T02:35:05.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 0x55d49b2af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 0x55d49b31db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d49b1b7510 con 0x55d49b296050 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d49b210c50 con 0x55d49b320080 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d49b2685c0 con 0x55d49b268180 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43242/0 (socket says 172.21.15.119:43242) 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 -- 172.21.15.119:0/3219235482 learned_addr learned my addr 172.21.15.119:0/3219235482 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 0x55d49b2af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcd0a4640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 0x55d49b31db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 -- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 msgr2=0x55d49b2af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 0x55d49b2af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 -- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 msgr2=0x55d49b31db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 0x55d49b31db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 -- 172.21.15.119:0/3219235482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d49b267e10 con 0x55d49b296050 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 0x55d49b2af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bcd0a4640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 0x55d49b31db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800a5d0 tx=0x7f5bb8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30db74006bcc7f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc6ffd640 1 -- 172.21.15.119:0/3219235482 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8068070 con 0x55d49b296050 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc6ffd640 1 -- 172.21.15.119:0/3219235482 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb80505a0 con 0x55d49b296050 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.891+0000 7f5bc6ffd640 1 -- 172.21.15.119:0/3219235482 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8050c10 con 0x55d49b296050 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/3219235482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 msgr2=0x55d49b3cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800a5d0 tx=0x7f5bb8051000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/3219235482 shutdown_connections 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b320080 0x55d49b31db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b296050 0x55d49b3cba00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/3219235482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b268180 0x55d49b2af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/3219235482 >> 172.21.15.119:0/3219235482 conn(0x55d49b2659e0 msgr2=0x55d49b265dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/3219235482 shutdown_connections 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.892+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/3219235482 wait complete. 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 Processor -- start 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 -- start start 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b268180 0x55d49b31dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b296050 0x55d49b325bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 0x55d49b320650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d49b267b30 con 0x55d49b320080 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d49b2ac9c0 con 0x55d49b268180 2024-09-12T02:35:05.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcfa20f40 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d49b33fef0 con 0x55d49b296050 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcd0a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 0x55d49b320650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcd0a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 0x55d49b320650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43244/0 (socket says 172.21.15.119:43244) 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.893+0000 7f5bcd0a4640 1 -- 172.21.15.119:0/711841710 learned_addr learned my addr 172.21.15.119:0/711841710 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b296050 0x55d49b325bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b268180 0x55d49b31dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 -- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b296050 msgr2=0x55d49b325bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d49b296050 0x55d49b325bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 -- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b268180 msgr2=0x55d49b31dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b268180 0x55d49b31dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 -- 172.21.15.119:0/711841710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d49b324e10 con 0x55d49b320080 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d49b268180 0x55d49b31dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcd0a4640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 0x55d49b320650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8003240 tx=0x7f5bc800c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bc5ffb640 1 -- 172.21.15.119:0/711841710 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8015030 con 0x55d49b320080 2024-09-12T02:35:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bc5ffb640 1 -- 172.21.15.119:0/711841710 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc800ce10 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d49b3250f0 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bc5ffb640 1 -- 172.21.15.119:0/711841710 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8011820 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.894+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d49b3256b0 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.895+0000 7f5bc5ffb640 1 -- 172.21.15.119:0/711841710 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bc8018070 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bc5ffb640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5bb006a810 0x7f5bb006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bc5ffb640 1 -- 172.21.15.119:0/711841710 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5bc8089a60 con 0x55d49b320080 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5bb006a810 0x7f5bb006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55d49b320b90 0x55d49b33afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55d49b321570 con 0x55d49b320b90 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bcc8a3640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5bb006a810 0x7f5bb006ccd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0001ed0 tx=0x7f5bc0001670 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.896+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55d49b320b90 0x55d49b33afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bc7fff640 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55d49b320b90 0x55d49b33afe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bc7fff640 1 -- 172.21.15.119:0/711841710 <== osd.5 v2:172.21.15.153:6824/2972675875 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (92) out=92b] v0'0 uv6 ondisk = 0) ==== 164+0+92 (crc 0 0 0) 0x7f5bb806b070 con 0x55d49b320b90 2024-09-12T02:35:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:Valphamydir 2024-09-12T02:35:05.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55d49b320b90 msgr2=0x55d49b33afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x55d49b320b90 0x55d49b33afe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5bb006a810 msgr2=0x7f5bb006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f5bb006a810 0x7f5bb006ccd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0001ed0 tx=0x7f5bc0001670 comp rx=0 tx=0).stop 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 msgr2=0x55d49b320650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 --2- 172.21.15.119:0/711841710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d49b320080 0x55d49b320650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8003240 tx=0x7f5bc800c5e0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcd0a4640 1 -- 172.21.15.119:0/711841710 reap_dead start 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 shutdown_connections 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 >> 172.21.15.119:0/711841710 conn(0x55d49b2659e0 msgr2=0x55d49b2af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 shutdown_connections 2024-09-12T02:35:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:05.897+0000 7f5bcfa20f40 1 -- 172.21.15.119:0/711841710 wait complete. 2024-09-12T02:35:05.907 DEBUG:teuthology.orchestra.run.smithi119:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-12T02:35:06.043 INFO:teuthology.orchestra.run.smithi119.stderr:error: stray data at end of buffer, offset 92 2024-09-12T02:35:06.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:06.057 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:06.057 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:06.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:06.160 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:06.160 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:06.161 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:06.161 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:06.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20685 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:06.178 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:06.178 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:35:06.178 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:06.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17709 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:06.195 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:06.195 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:06.195 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:06.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20685 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:06.234 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:06.235 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:35:06.235 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:06.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17709 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:06.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:06.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.371+0000 7f44709f6640 1 Processor -- start 2024-09-12T02:35:06.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.371+0000 7f44709f6640 1 -- start start 2024-09-12T02:35:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f44709f6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f446c0afd60 0x7f446c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f44709f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 0x7f446c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f44709f6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446c0b44c0 con 0x7f446c072bf0 2024-09-12T02:35:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f44709f6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f446c0b0140 con 0x7f446c0afd60 2024-09-12T02:35:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f44709f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f446c073030 con 0x7f446c0b3e60 2024-09-12T02:35:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f446a59c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f446c0afd60 0x7f446c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f4469d9b640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f446c072bf0 0x7f446c0b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:37930/0 (socket says 172.21.15.119:37930) 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f4469d9b640 1 -- 172.21.15.119:0/672307216 learned_addr learned my addr 172.21.15.119:0/672307216 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.372+0000 7f446ad9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 0x7f446c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446959a640 1 -- 172.21.15.119:0/672307216 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802901670 0 0) 0x7f446c0b44c0 con 0x7f446c072bf0 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446959a640 1 -- 172.21.15.119:0/672307216 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4458003520 con 0x7f446c072bf0 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446a59c640 1 -- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 msgr2=0x7f446c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446a59c640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 0x7f446c06f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446a59c640 1 -- 172.21.15.119:0/672307216 >> v1:172.21.15.153:6789/0 conn(0x7f446c072bf0 legacy=0x7f446c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446a59c640 1 -- 172.21.15.119:0/672307216 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c15ead0 con 0x7f446c0afd60 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.373+0000 7f446ad9d640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 0x7f446c06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f446a59c640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0afd60 0x7f446c0726b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f445c009d90 tx=0x7f445c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735f9883c4af60bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f446959a640 1 -- 172.21.15.119:0/672307216 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c007740 con 0x7f446c0afd60 2024-09-12T02:35:06.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f446959a640 1 -- 172.21.15.119:0/672307216 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f445c0078e0 con 0x7f446c0afd60 2024-09-12T02:35:06.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f446959a640 1 -- 172.21.15.119:0/672307216 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c007c90 con 0x7f446c0afd60 2024-09-12T02:35:06.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f44709f6640 1 -- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0afd60 msgr2=0x7f446c0726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.374+0000 7f44709f6640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0afd60 0x7f446c0726b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f445c009d90 tx=0x7f445c02a660 comp rx=0 tx=0).stop 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 -- 172.21.15.119:0/672307216 shutdown_connections 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c0b3e60 0x7f446c06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 --2- 172.21.15.119:0/672307216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0afd60 0x7f446c0726b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 -- 172.21.15.119:0/672307216 >> 172.21.15.119:0/672307216 conn(0x7f446c06c030 msgr2=0x7f446c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 -- 172.21.15.119:0/672307216 shutdown_connections 2024-09-12T02:35:06.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.375+0000 7f44709f6640 1 -- 172.21.15.119:0/672307216 wait complete. 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.376+0000 7f44709f6640 1 Processor -- start 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.376+0000 7f44709f6640 1 -- start start 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c072bf0 0x7f446c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0b3e60 0x7f446c1f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f446c15f370 con 0x7f446c0afd60 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f446c15f090 con 0x7f446c0b3e60 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f446c15f890 con 0x7f446c072bf0 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43258/0 (socket says 172.21.15.119:43258) 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 -- 172.21.15.119:0/7886798 learned_addr learned my addr 172.21.15.119:0/7886798 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f446a59c640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c072bf0 0x7f446c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f446ad9d640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0b3e60 0x7f446c1f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 -- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c072bf0 msgr2=0x7f446c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c072bf0 0x7f446c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 -- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0b3e60 msgr2=0x7f446c1f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0b3e60 0x7f446c1f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 -- 172.21.15.119:0/7886798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c1f8030 con 0x7f446c0afd60 2024-09-12T02:35:06.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4469d9b640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f445400c430 tx=0x7f445400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454017070 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4454005ce0 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c1f8310 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540072f0 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.377+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c0b07f0 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.378+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c0726b0 con 0x7f446c0afd60 2024-09-12T02:35:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.379+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f445401a070 con 0x7f446c0afd60 2024-09-12T02:35:06.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.379+0000 7f4462ffd640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 0x7f444c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.380+0000 7f446a59c640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 0x7f444c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.380+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f445408a480 con 0x7f446c0afd60 2024-09-12T02:35:06.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.380+0000 7f446a59c640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 0x7f444c06e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f445c034000 tx=0x7f445c02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.384+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4454058ca0 con 0x7f446c0afd60 2024-09-12T02:35:06.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.583+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f446c0b09c0 con 0x7f446c0afd60 2024-09-12T02:35:06.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.583+0000 7f4462ffd640 1 -- 172.21.15.119:0/7886798 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f44540585a0 con 0x7f446c0afd60 2024-09-12T02:35:06.585 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:06.585 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 msgr2=0x7f444c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 0x7f444c06e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f445c034000 tx=0x7f445c02f000 comp rx=0 tx=0).stop 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 msgr2=0x7f446c150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f445400c430 tx=0x7f445400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 shutdown_connections 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f444c06be60 0x7f444c06e320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f446c0b3e60 0x7f446c1f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446c0afd60 0x7f446c150e60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 --2- 172.21.15.119:0/7886798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f446c072bf0 0x7f446c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 >> 172.21.15.119:0/7886798 conn(0x7f446c06c030 msgr2=0x7f446c160750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 shutdown_connections 2024-09-12T02:35:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.585+0000 7f44709f6640 1 -- 172.21.15.119:0/7886798 wait complete. 2024-09-12T02:35:06.597 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:06.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.694+0000 7f85601fd640 1 Processor -- start 2024-09-12T02:35:06.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 -- start start 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f855815b300 0x7f85580cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85580cd3f0 0x7f855806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580cdbe0 con 0x7f8558072d30 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f85580728a0 con 0x7f85580cd3f0 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.695+0000 7f85601fd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f85580cd900 con 0x7f855815b300 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855d798640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85580cd3f0 0x7f855806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855e79a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8558072d30 0x7f85580b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40696/0 (socket says 172.21.15.119:40696) 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855e79a640 1 -- 172.21.15.119:0/1517361680 learned_addr learned my addr 172.21.15.119:0/1517361680 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855df99640 1 --2- 172.21.15.119:0/1517361680 >> v2:172.21.15.153:3300/0 conn(0x7f855815b300 0x7f85580cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855d798640 1 -- 172.21.15.119:0/1517361680 >> v2:172.21.15.153:3300/0 conn(0x7f855815b300 msgr2=0x7f85580cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855d798640 1 --2- 172.21.15.119:0/1517361680 >> v2:172.21.15.153:3300/0 conn(0x7f855815b300 0x7f85580cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855d798640 1 -- 172.21.15.119:0/1517361680 >> v1:172.21.15.119:6789/0 conn(0x7f8558072d30 legacy=0x7f85580b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855d798640 1 -- 172.21.15.119:0/1517361680 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558072250 con 0x7f85580cd3f0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.696+0000 7f855cf97640 1 -- 172.21.15.119:0/1517361680 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277376873 0 0) 0x7f85580cdbe0 con 0x7f8558072d30 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f855d798640 1 --2- 172.21.15.119:0/1517361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85580cd3f0 0x7f855806f1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8558070250 tx=0x7f854c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3f39acb0cbf8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f855cf97640 1 -- 172.21.15.119:0/1517361680 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c007740 con 0x7f85580cd3f0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f855cf97640 1 -- 172.21.15.119:0/1517361680 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c0078e0 con 0x7f85580cd3f0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f855cf97640 1 -- 172.21.15.119:0/1517361680 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c007cb0 con 0x7f85580cd3f0 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 -- 172.21.15.119:0/1517361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85580cd3f0 msgr2=0x7f855806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 --2- 172.21.15.119:0/1517361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85580cd3f0 0x7f855806f1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8558070250 tx=0x7f854c02a680 comp rx=0 tx=0).stop 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 -- 172.21.15.119:0/1517361680 shutdown_connections 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 --2- 172.21.15.119:0/1517361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85580cd3f0 0x7f855806f1c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 --2- 172.21.15.119:0/1517361680 >> v2:172.21.15.153:3300/0 conn(0x7f855815b300 0x7f85580cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 -- 172.21.15.119:0/1517361680 >> 172.21.15.119:0/1517361680 conn(0x7f8558067d70 msgr2=0x7f855806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 -- 172.21.15.119:0/1517361680 shutdown_connections 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.697+0000 7f85601fd640 1 -- 172.21.15.119:0/1517361680 wait complete. 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.698+0000 7f85601fd640 1 Processor -- start 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 -- start start 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8558072d30 0x7f85580cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85580cd3f0 0x7f855814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d0160 con 0x7f855815b300 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85580cffe0 con 0x7f85580cd3f0 2024-09-12T02:35:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f85601fd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f855806f700 con 0x7f8558072d30 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f855e79a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f855e79a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43272/0 (socket says 172.21.15.119:43272) 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f855e79a640 1 -- 172.21.15.119:0/455448037 learned_addr learned my addr 172.21.15.119:0/455448037 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f855d798640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85580cd3f0 0x7f855814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.699+0000 7f855df99640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8558072d30 0x7f85580cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 -- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8558072d30 msgr2=0x7f85580cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8558072d30 0x7f85580cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 -- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85580cd3f0 msgr2=0x7f855814b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85580cd3f0 0x7f855814b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 -- 172.21.15.119:0/455448037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558149d60 con 0x7f855815b300 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f855e79a640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f854800c450 tx=0x7f854800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548018070 con 0x7f855815b300 2024-09-12T02:35:06.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548007500 con 0x7f855815b300 2024-09-12T02:35:06.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85581497a0 con 0x7f855815b300 2024-09-12T02:35:06.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548004a20 con 0x7f855815b300 2024-09-12T02:35:06.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.700+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581672f0 con 0x7f855815b300 2024-09-12T02:35:06.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.701+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855806fac0 con 0x7f855815b300 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.701+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f854801b070 con 0x7f855815b300 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.702+0000 7f85567fc640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.702+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f854808a1c0 con 0x7f855815b300 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.702+0000 7f855df99640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.702+0000 7f855df99640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 0x7f854406e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f855815a080 tx=0x7f8550009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.706+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8548058390 con 0x7f855815b300 2024-09-12T02:35:06.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.904+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85580cd160 con 0x7f855815b300 2024-09-12T02:35:06.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.904+0000 7f85567fc640 1 -- 172.21.15.119:0/455448037 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f854805c690 con 0x7f855815b300 2024-09-12T02:35:06.905 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:06.905 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:06.905 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 msgr2=0x7f854406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 0x7f854406e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f855815a080 tx=0x7f8550009190 comp rx=0 tx=0).stop 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 msgr2=0x7f8558146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f854800c450 tx=0x7f854800c910 comp rx=0 tx=0).stop 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 shutdown_connections 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f855815b300 0x7f8558146f00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85580cd3f0 0x7f855814b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 --2- 172.21.15.119:0/455448037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8558072d30 0x7f85580cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 >> 172.21.15.119:0/455448037 conn(0x7f8558067d70 msgr2=0x7f85581515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 shutdown_connections 2024-09-12T02:35:06.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:06.906+0000 7f85601fd640 1 -- 172.21.15.119:0/455448037 wait complete. 2024-09-12T02:35:06.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:07.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.015+0000 7fce45bb9640 1 Processor -- start 2024-09-12T02:35:07.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.015+0000 7fce45bb9640 1 -- start start 2024-09-12T02:35:07.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce45bb9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce40070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce45bb9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4006cb30 con 0x7fce400d0bb0 2024-09-12T02:35:07.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce45bb9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4006bfb0 con 0x7fce40070dd0 2024-09-12T02:35:07.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce45bb9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce4006c290 con 0x7fce40147360 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce3ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fce400d0bb0 0x7fce400ae550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40706/0 (socket says 172.21.15.119:40706) 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.016+0000 7fce3ffff640 1 -- 172.21.15.119:0/2091955699 learned_addr learned my addr 172.21.15.119:0/2091955699 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031781122 0 0) 0x7fce4006cb30 con 0x7fce400d0bb0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce40070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce28003520 con 0x7fce400d0bb0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3054911220 0 0) 0x7fce28003520 con 0x7fce400d0bb0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 msgr2=0x7fce40070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce40070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 >> v1:172.21.15.153:6789/0 conn(0x7fce40070dd0 legacy=0x7fce400d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4006c570 con 0x7fce400d0bb0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fce380019f0 con 0x7fce400d0bb0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 >> v1:172.21.15.119:6789/0 conn(0x7fce400d0bb0 legacy=0x7fce400ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce280039e0 0x7fce28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce28004d40 0x7fce280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce4006c290 con 0x7fce280039e0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800baf0 con 0x7fce28004d40 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce2800bcf0 con 0x7fce40147360 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce280039e0 0x7fce28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3ffff640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce28004d40 0x7fce280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3effd640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 -- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 msgr2=0x7fce28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 -- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce28004d40 msgr2=0x7fce280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce28004d40 0x7fce280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3f7fe640 1 -- 172.21.15.119:0/2091955699 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce28003520 con 0x7fce280039e0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.017+0000 7fce3effd640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce40147360 0x7fce28004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.018+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce280039e0 0x7fce28003e00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fce30009ac0 tx=0x7fce28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7434108e3e2f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.018+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30036070 con 0x7fce280039e0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.018+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce30031400 con 0x7fce280039e0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.018+0000 7fce3e7fc640 1 -- 172.21.15.119:0/2091955699 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30009690 con 0x7fce280039e0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 -- 172.21.15.119:0/2091955699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce280039e0 msgr2=0x7fce28003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2091955699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce280039e0 0x7fce28003e00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fce30009ac0 tx=0x7fce28005830 comp rx=0 tx=0).stop 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce3ffff640 1 -- 172.21.15.119:0/2091955699 reap_dead start 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 -- 172.21.15.119:0/2091955699 shutdown_connections 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 -- 172.21.15.119:0/2091955699 >> 172.21.15.119:0/2091955699 conn(0x7fce400b2f40 msgr2=0x7fce400b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 -- 172.21.15.119:0/2091955699 shutdown_connections 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.019+0000 7fce45bb9640 1 -- 172.21.15.119:0/2091955699 wait complete. 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.020+0000 7fce45bb9640 1 Processor -- start 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.020+0000 7fce45bb9640 1 -- start start 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce280039e0 0x7fce4013bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce40161140 0x7fce401f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce4006bd90 con 0x7fce4013ddc0 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce4006bc10 con 0x7fce40161140 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce40070890 con 0x7fce280039e0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43296/0 (socket says 172.21.15.119:43296) 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 -- 172.21.15.119:0/2332450911 learned_addr learned my addr 172.21.15.119:0/2332450911 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3ffff640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce40161140 0x7fce401f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce280039e0 0x7fce4013bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 -- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce280039e0 msgr2=0x7fce4013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce280039e0 0x7fce4013bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 -- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce40161140 msgr2=0x7fce401f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce40161140 0x7fce401f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 -- 172.21.15.119:0/2332450911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4013c340 con 0x7fce4013ddc0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce3effd640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e5a0 tx=0x7fce3400ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce340052e0 con 0x7fce4013ddc0 2024-09-12T02:35:07.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34018070 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4013c620 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34003830 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.021+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4013e240 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.022+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce400d04a0 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.023+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce340039d0 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.023+0000 7fce27fff640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 0x7fce2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.023+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 0x7fce2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.023+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fce3408aba0 con 0x7fce4013ddc0 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.024+0000 7fce3f7fe640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 0x7fce2c06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce30033000 tx=0x7fce30008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.027+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce34058e00 con 0x7fce4013ddc0 2024-09-12T02:35:07.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.198+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce400af1f0 con 0x7fce4013ddc0 2024-09-12T02:35:07.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.199+0000 7fce27fff640 1 -- 172.21.15.119:0/2332450911 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7fce3405d100 con 0x7fce4013ddc0 2024-09-12T02:35:07.200 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:07.200 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":40,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:54.908247+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:50.903271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T02:34:52.212895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 msgr2=0x7fce2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 0x7fce2c06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce30033000 tx=0x7fce30008030 comp rx=0 tx=0).stop 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 msgr2=0x7fce40160c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e5a0 tx=0x7fce3400ea60 comp rx=0 tx=0).stop 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 shutdown_connections 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce2c06be60 0x7fce2c06e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce40161140 0x7fce401f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4013ddc0 0x7fce40160c00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 --2- 172.21.15.119:0/2332450911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce280039e0 0x7fce4013bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 >> 172.21.15.119:0/2332450911 conn(0x7fce400b2f40 msgr2=0x7fce40161640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 shutdown_connections 2024-09-12T02:35:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.201+0000 7fce45bb9640 1 -- 172.21.15.119:0/2332450911 wait complete. 2024-09-12T02:35:07.213 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:35:07.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:07.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.311+0000 7f8ba2923640 1 Processor -- start 2024-09-12T02:35:07.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.311+0000 7f8ba2923640 1 -- start start 2024-09-12T02:35:07.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba2923640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b9c072d30 0x7f8b9c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba2923640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c06f700 0x7f8b9c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba2923640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9c0cdbe0 con 0x7f8b9c15b300 2024-09-12T02:35:07.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba2923640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0728a0 con 0x7f8b9c072d30 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba2923640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c06fb30 con 0x7f8b9c06f700 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8b9b7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b9c072d30 0x7f8b9c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8ba0ec0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c06f700 0x7f8b9c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8b9b7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b9c072d30 0x7f8b9c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:52446/0 (socket says 172.21.15.119:52446) 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8b9b7fe640 1 -- 172.21.15.119:0/3375382823 learned_addr learned my addr 172.21.15.119:0/3375382823 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.312+0000 7f8b9bfff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8b9c15b300 0x7f8b9c0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:37936/0 (socket says 172.21.15.119:37936) 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.313+0000 7f8b9b7fe640 1 -- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c06f700 msgr2=0x7f8b9c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.313+0000 7f8b9b7fe640 1 --2- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c06f700 0x7f8b9c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.313+0000 7f8b9b7fe640 1 -- 172.21.15.119:0/3375382823 >> v1:172.21.15.153:6789/0 conn(0x7f8b9c15b300 legacy=0x7f8b9c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.313+0000 7f8b9b7fe640 1 -- 172.21.15.119:0/3375382823 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c0cd900 con 0x7f8b9c072d30 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.313+0000 7f8b9b7fe640 1 --2- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c072d30 0x7f8b9c06f1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009870 tx=0x7f8b9002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa90bd26fea5756d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8b9affd640 1 -- 172.21.15.119:0/3375382823 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90037070 con 0x7f8b9c072d30 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8b9affd640 1 -- 172.21.15.119:0/3375382823 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90032440 con 0x7f8b9c072d30 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8b9affd640 1 -- 172.21.15.119:0/3375382823 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90032810 con 0x7f8b9c072d30 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 -- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c072d30 msgr2=0x7f8b9c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 --2- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c072d30 0x7f8b9c06f1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009870 tx=0x7f8b9002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 -- 172.21.15.119:0/3375382823 shutdown_connections 2024-09-12T02:35:07.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 --2- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c06f700 0x7f8b9c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 --2- 172.21.15.119:0/3375382823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c072d30 0x7f8b9c06f1c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 -- 172.21.15.119:0/3375382823 >> 172.21.15.119:0/3375382823 conn(0x7f8b9c067d70 msgr2=0x7f8b9c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 -- 172.21.15.119:0/3375382823 shutdown_connections 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.314+0000 7f8ba2923640 1 -- 172.21.15.119:0/3375382823 wait complete. 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.315+0000 7f8ba2923640 1 Processor -- start 2024-09-12T02:35:07.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.315+0000 7f8ba2923640 1 -- start start 2024-09-12T02:35:07.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c06f700 0x7f8b9c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 0x7f8b9c0c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c0cd5c0 con 0x7f8b9c15b300 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c072530 con 0x7f8b9c06f700 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba2923640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c0cffe0 con 0x7f8b9c072d30 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba0ec0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba0ec0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43304/0 (socket says 172.21.15.119:43304) 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8ba0ec0640 1 -- 172.21.15.119:0/365965528 learned_addr learned my addr 172.21.15.119:0/365965528 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8b9b7fe640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 0x7f8b9c0c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.316+0000 7f8b9bfff640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c06f700 0x7f8b9c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 -- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 msgr2=0x7f8b9c0c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 0x7f8b9c0c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 -- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c06f700 msgr2=0x7f8b9c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c06f700 0x7f8b9c14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 -- 172.21.15.119:0/365965528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c156310 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8b9b7fe640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 0x7f8b9c0c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba0ec0640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400efc0 tx=0x7f8b9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94018020 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94014480 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c1565f0 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94014870 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.317+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c152620 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.318+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c15c6b0 con 0x7f8b9c15b300 2024-09-12T02:35:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.318+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b94005d10 con 0x7f8b9c15b300 2024-09-12T02:35:07.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.319+0000 7f8b98ff9640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.319+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8b9408bcf0 con 0x7f8b9c15b300 2024-09-12T02:35:07.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.319+0000 7f8b9bfff640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.319+0000 7f8b9bfff640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 0x7f8b8806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f60 tx=0x7f8b8c007e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.323+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b94090070 con 0x7f8b9c15b300 2024-09-12T02:35:07.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.521+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b9c15c3d0 con 0x7f8b9c15b300 2024-09-12T02:35:07.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.521+0000 7f8b98ff9640 1 -- 172.21.15.119:0/365965528 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f8b94022030 con 0x7f8b9c15b300 2024-09-12T02:35:07.522 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:07.522 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:07.522 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 msgr2=0x7f8b8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 0x7f8b8806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f60 tx=0x7f8b8c007e20 comp rx=0 tx=0).stop 2024-09-12T02:35:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 msgr2=0x7f8b9c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400efc0 tx=0x7f8b9400c490 comp rx=0 tx=0).stop 2024-09-12T02:35:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 shutdown_connections 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b9c15b300 0x7f8b9c0c5c60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b9c072d30 0x7f8b9c0c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 --2- 172.21.15.119:0/365965528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b9c06f700 0x7f8b9c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 >> 172.21.15.119:0/365965528 conn(0x7f8b9c067d70 msgr2=0x7f8b9c15cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 shutdown_connections 2024-09-12T02:35:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.523+0000 7f8ba2923640 1 -- 172.21.15.119:0/365965528 wait complete. 2024-09-12T02:35:07.535 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:07.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.631+0000 7f98eede4640 1 Processor -- start 2024-09-12T02:35:07.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.631+0000 7f98eede4640 1 -- start start 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98eede4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98eede4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98eede4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e806e000 con 0x7f98e806d4c0 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98eede4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f98e815eb20 con 0x7f98e815e740 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98eede4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f98e806d260 con 0x7f98e809b690 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98ecb80640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98dffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.632+0000 7f98ed381640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f98e806d4c0 0x7f98e806d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:37948/0 (socket says 172.21.15.119:37948) 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98dffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:38628/0 (socket says 172.21.15.119:38628) 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98ecb80640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:52466/0 (socket says 172.21.15.119:52466) 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98ed381640 1 -- 172.21.15.119:0/4226271762 learned_addr learned my addr 172.21.15.119:0/4226271762 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:07.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98dffff640 1 -- 172.21.15.119:0/4226271762 >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 msgr2=0x7f98e80d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98dffff640 1 --2- 172.21.15.119:0/4226271762 >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98dffff640 1 -- 172.21.15.119:0/4226271762 >> v1:172.21.15.153:6789/0 conn(0x7f98e806d4c0 legacy=0x7f98e806d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98dffff640 1 -- 172.21.15.119:0/4226271762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e80d0780 con 0x7f98e809b690 2024-09-12T02:35:07.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.633+0000 7f98ecb80640 1 --2- 172.21.15.119:0/4226271762 >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:07.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98dffff640 1 --2- 172.21.15.119:0/4226271762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d80097a0 tx=0x7f98d802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46be619e5efd60d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98df7fe640 1 -- 172.21.15.119:0/4226271762 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d8037070 con 0x7f98e809b690 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98df7fe640 1 -- 172.21.15.119:0/4226271762 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d8032440 con 0x7f98e809b690 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98df7fe640 1 -- 172.21.15.119:0/4226271762 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d8032810 con 0x7f98e809b690 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 -- 172.21.15.119:0/4226271762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 msgr2=0x7f98e806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 --2- 172.21.15.119:0/4226271762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d80097a0 tx=0x7f98d802a210 comp rx=0 tx=0).stop 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 -- 172.21.15.119:0/4226271762 shutdown_connections 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 --2- 172.21.15.119:0/4226271762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e809b690 0x7f98e806cd20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 --2- 172.21.15.119:0/4226271762 >> v2:172.21.15.153:3300/0 conn(0x7f98e815e740 0x7f98e80d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 -- 172.21.15.119:0/4226271762 >> 172.21.15.119:0/4226271762 conn(0x7f98e80d23a0 msgr2=0x7f98e80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 -- 172.21.15.119:0/4226271762 shutdown_connections 2024-09-12T02:35:07.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.634+0000 7f98eede4640 1 -- 172.21.15.119:0/4226271762 wait complete. 2024-09-12T02:35:07.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.635+0000 7f98eede4640 1 Processor -- start 2024-09-12T02:35:07.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.635+0000 7f98eede4640 1 -- start start 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98e809b690 0x7f98e80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e815e740 0x7f98e8070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80d1020 con 0x7f98e806d4c0 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80d0d40 con 0x7f98e809b690 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98eede4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f98e809ba90 con 0x7f98e815e740 2024-09-12T02:35:07.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98ecb80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98ecb80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43308/0 (socket says 172.21.15.119:43308) 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.636+0000 7f98ecb80640 1 -- 172.21.15.119:0/2358199561 learned_addr learned my addr 172.21.15.119:0/2358199561 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ed381640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e815e740 0x7f98e8070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98dffff640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98e809b690 0x7f98e80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 -- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e815e740 msgr2=0x7f98e8070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e815e740 0x7f98e8070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 -- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98e809b690 msgr2=0x7f98e80c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98e809b690 0x7f98e80c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 -- 172.21.15.119:0/2358199561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e80b6820 con 0x7f98e806d4c0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98ecb80640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f98e400ec10 tx=0x7f98e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4017070 con 0x7f98e806d4c0 2024-09-12T02:35:07.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e400cc30 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e80b6b00 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4013470 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.637+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e80b70c0 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.638+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e806cd20 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.639+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98e401a070 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.639+0000 7f98dd7fa640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 0x7f98d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.639+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f98e408b2b0 con 0x7f98e806d4c0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.639+0000 7f98dffff640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 0x7f98d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.639+0000 7f98dffff640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 0x7f98d406e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f98d8034000 tx=0x7f98d802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.643+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98e4059ad0 con 0x7f98e806d4c0 2024-09-12T02:35:07.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.843+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98e80d1cb0 con 0x7f98e806d4c0 2024-09-12T02:35:07.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.844+0000 7f98dd7fa640 1 -- 172.21.15.119:0/2358199561 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5232 (secure 0 0 0) 0x7f98e40593d0 con 0x7f98e806d4c0 2024-09-12T02:35:07.845 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:07.845 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":15,"btime":"2024-09-12T02:34:55:914523+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:34:53.232474+0000","modified":"2024-09-12T02:34:55.245124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/3594830331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3594830331},{"type":"v1","addr":"172.21.15.153:6835","nonce":3594830331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-12T02:35:07.845 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 15 2024-09-12T02:35:07.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 msgr2=0x7f98d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 0x7f98d406e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f98d8034000 tx=0x7f98d802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 msgr2=0x7f98e80b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f98e400ec10 tx=0x7f98e400c520 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 shutdown_connections 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f98d406be60 0x7f98d406e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98e815e740 0x7f98e8070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98e809b690 0x7f98e80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 --2- 172.21.15.119:0/2358199561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e806d4c0 0x7f98e80b6240 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 >> 172.21.15.119:0/2358199561 conn(0x7f98e80d23a0 msgr2=0x7f98e80b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 shutdown_connections 2024-09-12T02:35:07.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.846+0000 7f98eede4640 1 -- 172.21.15.119:0/2358199561 wait complete. 2024-09-12T02:35:07.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:07.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 Processor -- start 2024-09-12T02:35:07.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 -- start start 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 0x7f47c80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 0x7f47c80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c80d3690 con 0x7f47c80b64c0 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f47c806d530 con 0x7f47c80d30f0 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.956+0000 7f47cd32a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80d3970 con 0x7f47c815e5f0 2024-09-12T02:35:07.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c67fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 0x7f47c80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c6ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 0x7f47c80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c77fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f47c80b64c0 0x7f47c80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:37964/0 (socket says 172.21.15.119:37964) 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c77fe640 1 -- 172.21.15.119:0/2456803949 learned_addr learned my addr 172.21.15.119:0/2456803949 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c6ffd640 1 -- 172.21.15.119:0/2456803949 >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 msgr2=0x7f47c80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c6ffd640 1 --2- 172.21.15.119:0/2456803949 >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 0x7f47c80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c6ffd640 1 -- 172.21.15.119:0/2456803949 >> v1:172.21.15.153:6789/0 conn(0x7f47c80b64c0 legacy=0x7f47c80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c6ffd640 1 -- 172.21.15.119:0/2456803949 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c806cee0 con 0x7f47c815e5f0 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c5ffb640 1 -- 172.21.15.119:0/2456803949 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233397045 0 0) 0x7f47c80d3690 con 0x7f47c80b64c0 2024-09-12T02:35:07.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.957+0000 7f47c67fc640 1 --2- 172.21.15.119:0/2456803949 >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 0x7f47c80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.958+0000 7f47c6ffd640 1 --2- 172.21.15.119:0/2456803949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 0x7f47c80d4dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f47b80097a0 tx=0x7f47b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46910106999dc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.958+0000 7f47c5ffb640 1 -- 172.21.15.119:0/2456803949 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8037070 con 0x7f47c815e5f0 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.958+0000 7f47c5ffb640 1 -- 172.21.15.119:0/2456803949 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b8032440 con 0x7f47c815e5f0 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.958+0000 7f47c5ffb640 1 -- 172.21.15.119:0/2456803949 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8032810 con 0x7f47c815e5f0 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 -- 172.21.15.119:0/2456803949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 msgr2=0x7f47c80d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 --2- 172.21.15.119:0/2456803949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 0x7f47c80d4dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f47b80097a0 tx=0x7f47b802a180 comp rx=0 tx=0).stop 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 -- 172.21.15.119:0/2456803949 shutdown_connections 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 --2- 172.21.15.119:0/2456803949 >> v2:172.21.15.153:3300/0 conn(0x7f47c80d30f0 0x7f47c80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 --2- 172.21.15.119:0/2456803949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c815e5f0 0x7f47c80d4dd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 -- 172.21.15.119:0/2456803949 >> 172.21.15.119:0/2456803949 conn(0x7f47c808bfc0 msgr2=0x7f47c80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 -- 172.21.15.119:0/2456803949 shutdown_connections 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.959+0000 7f47cd32a640 1 -- 172.21.15.119:0/2456803949 wait complete. 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.960+0000 7f47cd32a640 1 Processor -- start 2024-09-12T02:35:07.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.960+0000 7f47cd32a640 1 -- start start 2024-09-12T02:35:07.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47c80b64c0 0x7f47c80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c80d30f0 0x7f47c815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f47c80d5310 con 0x7f47c815e5f0 2024-09-12T02:35:07.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47c815e9d0 con 0x7f47c80b64c0 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47cd32a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f47c806e9d0 con 0x7f47c80d30f0 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47c80b64c0 0x7f47c80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43310/0 (socket says 172.21.15.119:43310) 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 -- 172.21.15.119:0/402350430 learned_addr learned my addr 172.21.15.119:0/402350430 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c67fc640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c80d30f0 0x7f47c815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 -- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c80d30f0 msgr2=0x7f47c815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c80d30f0 0x7f47c815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 -- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47c80b64c0 msgr2=0x7f47c80cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47c80b64c0 0x7f47c80cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 -- 172.21.15.119:0/402350430 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80b9310 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.961+0000 7f47c77fe640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c7a0 tx=0x7f47c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.962+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0018070 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.962+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c000a640 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.962+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c81f4830 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.962+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c000aab0 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.962+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c81f4df0 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.963+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80b5f80 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.963+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c001b070 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.963+0000 7f47bf7fe640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.964+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f47c008a450 con 0x7f47c815e5f0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.964+0000 7f47c6ffd640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.964+0000 7f47c6ffd640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 0x7f47a806e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47b8034000 tx=0x7f47b802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:07.968+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47c00586b0 con 0x7f47c815e5f0 2024-09-12T02:35:08.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.133+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47c80b1c10 con 0x7f47c815e5f0 2024-09-12T02:35:08.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.135+0000 7f47bf7fe640 1 -- 172.21.15.119:0/402350430 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7f47c005c9b0 con 0x7f47c815e5f0 2024-09-12T02:35:08.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:08.136 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":40,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:34:54.908247+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:50.903271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T02:34:52.212895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 msgr2=0x7f47a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 0x7f47a806e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47b8034000 tx=0x7f47b802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 msgr2=0x7f47c8160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c7a0 tx=0x7f47c000cc60 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 shutdown_connections 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47c815e5f0 0x7f47c8160b60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47c80d30f0 0x7f47c815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 --2- 172.21.15.119:0/402350430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47c80b64c0 0x7f47c80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 >> 172.21.15.119:0/402350430 conn(0x7f47c808bfc0 msgr2=0x7f47c80d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 shutdown_connections 2024-09-12T02:35:08.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.137+0000 7f47cd32a640 1 -- 172.21.15.119:0/402350430 wait complete. 2024-09-12T02:35:08.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:35:08.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.247+0000 7fa458731640 1 Processor -- start 2024-09-12T02:35:08.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.247+0000 7fa458731640 1 -- start start 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa458731640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa45015c870 0x7fa45015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa458731640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4500d01c0 con 0x7fa45015c490 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa458731640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4500d04a0 con 0x7fa4500ccf90 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa458731640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa4500cff70 con 0x7fa45015c870 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4564cd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa45015c490 0x7fa45009b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58054/0 (socket says 172.21.15.119:58054) 2024-09-12T02:35:08.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4564cd640 1 -- 172.21.15.119:0/1988731096 learned_addr learned my addr 172.21.15.119:0/1988731096 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68764176 0 0) 0x7fa4500d01c0 con 0x7fa45015c490 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa43c003520 con 0x7fa45015c490 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa455ccc640 1 --2- 172.21.15.119:0/1988731096 >> v2:172.21.15.153:3300/0 conn(0x7fa45015c870 0x7fa45015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273589911 0 0) 0x7fa43c003520 con 0x7fa45015c490 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 >> v2:172.21.15.153:3300/0 conn(0x7fa45015c870 msgr2=0x7fa45015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 --2- 172.21.15.119:0/1988731096 >> v2:172.21.15.153:3300/0 conn(0x7fa45015c870 0x7fa45015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 >> v1:172.21.15.153:6789/0 conn(0x7fa4500ccf90 legacy=0x7fa4500cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4500d0780 con 0x7fa45015c490 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.248+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fa44c001670 con 0x7fa45015c490 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 >> v1:172.21.15.119:6789/0 conn(0x7fa45015c490 legacy=0x7fa45009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0039b0 0x7fa43c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa43c004800 0x7fa43c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 0x7fa43c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500cff70 con 0x7fa43c0051c0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c00c070 con 0x7fa43c004800 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c00c270 con 0x7fa43c0039b0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 0x7fa43c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa455ccc640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa43c004800 0x7fa43c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa4564cd640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0039b0 0x7fa43c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 -- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0039b0 msgr2=0x7fa43c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0039b0 0x7fa43c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 -- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa43c004800 msgr2=0x7fa43c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa43c004800 0x7fa43c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.249+0000 7fa456cce640 1 -- 172.21.15.119:0/1988731096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c003520 con 0x7fa43c0051c0 2024-09-12T02:35:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa456cce640 1 -- 172.21.15.119:0/1988731096 reap_dead start 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa456cce640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 0x7fa43c00b9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa448001e50 tx=0x7fa43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203df74f8777cfda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448001a70 con 0x7fa43c0051c0 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448003970 con 0x7fa43c0051c0 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa4554cb640 1 -- 172.21.15.119:0/1988731096 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448003d60 con 0x7fa43c0051c0 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 -- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 msgr2=0x7fa43c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 0x7fa43c00b9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa448001e50 tx=0x7fa43c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 -- 172.21.15.119:0/1988731096 shutdown_connections 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 --2- 172.21.15.119:0/1988731096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43c0051c0 0x7fa43c00b9c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 -- 172.21.15.119:0/1988731096 >> 172.21.15.119:0/1988731096 conn(0x7fa4500d23a0 msgr2=0x7fa4500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 -- 172.21.15.119:0/1988731096 shutdown_connections 2024-09-12T02:35:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.250+0000 7fa458731640 1 -- 172.21.15.119:0/1988731096 wait complete. 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 Processor -- start 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 -- start start 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0051c0 0x7fa450156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4500b7530 0x7fa4500af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500d1260 con 0x7fa4500b7990 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500d0dd0 con 0x7fa4500b7530 2024-09-12T02:35:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa458731640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa4500b6a70 con 0x7fa43c0051c0 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa456cce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa456cce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58532/0 (socket says 172.21.15.119:58532) 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.252+0000 7fa456cce640 1 -- 172.21.15.119:0/516905788 learned_addr learned my addr 172.21.15.119:0/516905788 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa455ccc640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4500b7530 0x7fa4500af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa4564cd640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0051c0 0x7fa450156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 -- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0051c0 msgr2=0x7fa450156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0051c0 0x7fa450156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 -- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4500b7530 msgr2=0x7fa4500af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4500b7530 0x7fa4500af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 -- 172.21.15.119:0/516905788 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4500b5f20 con 0x7fa4500b7990 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa456cce640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa448001f70 tx=0x7fa4480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007db0 con 0x7fa4500b7990 2024-09-12T02:35:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44802ac70 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4500b6200 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448001a70 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.253+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4500b7010 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.254+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4500d01c0 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.255+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa448007030 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.255+0000 7fa446ffd640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 0x7fa43406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.255+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa4480aaa40 con 0x7fa4500b7990 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.255+0000 7fa4564cd640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 0x7fa43406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.255+0000 7fa4564cd640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 0x7fa43406e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa44c001eb0 tx=0x7fa44c0015b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.259+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa448043060 con 0x7fa4500b7990 2024-09-12T02:35:08.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.458+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa4500b71e0 con 0x7fa4500b7990 2024-09-12T02:35:08.459 INFO:tasks.ceph.mon.a.smithi119.stderr:2024-09-12T02:35:08.458+0000 7f4dbacdd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:35:08.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.459+0000 7fa446ffd640 1 -- 172.21.15.119:0/516905788 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fa4480793b0 con 0x7fa4500b7990 2024-09-12T02:35:08.460 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 msgr2=0x7fa43406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 0x7fa43406e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa44c001eb0 tx=0x7fa44c0015b0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 msgr2=0x7fa4500af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa448001f70 tx=0x7fa4480014a0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 shutdown_connections 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fa43406be60 0x7fa43406e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4500b7990 0x7fa4500af680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4500b7530 0x7fa4500af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 --2- 172.21.15.119:0/516905788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa43c0051c0 0x7fa450156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 >> 172.21.15.119:0/516905788 conn(0x7fa4500d23a0 msgr2=0x7fa450070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 shutdown_connections 2024-09-12T02:35:08.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.462+0000 7fa458731640 1 -- 172.21.15.119:0/516905788 wait complete. 2024-09-12T02:35:08.466 INFO:tasks.ceph.mds.b.smithi153.stderr: -4140> 2024-09-12T02:34:58.806+0000 7f1c1759a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:08.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:35:08.498 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-12T02:35:08.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.574+0000 7f6e7c08d640 1 Processor -- start 2024-09-12T02:35:08.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.574+0000 7f6e7c08d640 1 -- start start 2024-09-12T02:35:08.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e7c08d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e74169380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e7c08d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e740b6820 con 0x7f6e74158b50 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e7c08d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e740b6b00 con 0x7f6e7415f950 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e7c08d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e740b6de0 con 0x7f6e7409b140 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e79e29640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6e74158b50 0x7f6e740b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58070/0 (socket says 172.21.15.119:58070) 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e79e29640 1 -- 172.21.15.119:0/1545036294 learned_addr learned my addr 172.21.15.119:0/1545036294 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e7a62a640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e74169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46650467 0 0) 0x7f6e740b6820 con 0x7f6e74158b50 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.575+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5c003520 con 0x7f6e74158b50 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3745225495 0 0) 0x7f6e5c003520 con 0x7f6e74158b50 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 msgr2=0x7f6e74169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e74169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 >> v1:172.21.15.153:6789/0 conn(0x7f6e7415f950 legacy=0x7f6e7409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e740b70c0 con 0x7f6e74158b50 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f6e6c001670 con 0x7f6e74158b50 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 >> v1:172.21.15.119:6789/0 conn(0x7f6e74158b50 legacy=0x7f6e740b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c0039e0 0x7f6e5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e5c004390 0x7f6e5c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e5c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e740b6de0 con 0x7f6e5c004390 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c00b9f0 con 0x7f6e5c0039e0 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c00bbf0 con 0x7f6e7409b140 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e5c004390 0x7f6e5c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79e29640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c0039e0 0x7f6e5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e7a62a640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e5c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 -- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 msgr2=0x7f6e5c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e7409b140 0x7f6e5c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 -- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c0039e0 msgr2=0x7f6e5c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c0039e0 0x7f6e5c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.576+0000 7f6e79628640 1 -- 172.21.15.119:0/1545036294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c003520 con 0x7f6e5c004390 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.577+0000 7f6e79628640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e5c004390 0x7f6e5c004860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6e680018e0 tx=0x7f6e5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955aa6d88f9768d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.577+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68037070 con 0x7f6e5c004390 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.577+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6802ac10 con 0x7f6e5c004390 2024-09-12T02:35:08.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.577+0000 7f6e78e27640 1 -- 172.21.15.119:0/1545036294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680014e0 con 0x7f6e5c004390 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.577+0000 7f6e7c08d640 1 -- 172.21.15.119:0/1545036294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e5c004390 msgr2=0x7f6e5c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/1545036294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e5c004390 0x7f6e5c004860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6e680018e0 tx=0x7f6e5c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7a62a640 1 -- 172.21.15.119:0/1545036294 reap_dead start 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7c08d640 1 -- 172.21.15.119:0/1545036294 shutdown_connections 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7c08d640 1 -- 172.21.15.119:0/1545036294 >> 172.21.15.119:0/1545036294 conn(0x7f6e740b79e0 msgr2=0x7f6e740b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7c08d640 1 -- 172.21.15.119:0/1545036294 shutdown_connections 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.578+0000 7f6e7c08d640 1 -- 172.21.15.119:0/1545036294 wait complete. 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.579+0000 7f6e7c08d640 1 Processor -- start 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.579+0000 7f6e7c08d640 1 -- start start 2024-09-12T02:35:08.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.579+0000 7f6e7c08d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 0x7f6e7409ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e740affb0 0x7f6e7414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74158f30 con 0x7f6e740b0e10 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e740b6530 con 0x7f6e740affb0 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e741590b0 con 0x7f6e5c004390 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e79e29640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 0x7f6e7409ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58540/0 (socket says 172.21.15.119:58540) 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e79e29640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 0x7f6e7409ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:37690/0 (socket says 172.21.15.119:37690) 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 -- 172.21.15.119:0/2522942949 learned_addr learned my addr 172.21.15.119:0/2522942949 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e79628640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e740affb0 0x7f6e7414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 -- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 msgr2=0x7f6e7409ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 0x7f6e7409ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 -- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e740affb0 msgr2=0x7f6e7414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e740affb0 0x7f6e7414ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 -- 172.21.15.119:0/2522942949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e740b1380 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7a62a640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e7415ec30 tx=0x7f6e6400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011e60 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e64015430 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e740af4d0 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64015800 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.580+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e740afa90 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.581+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e740b09f0 con 0x7f6e740b0e10 2024-09-12T02:35:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.582+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e640159a0 con 0x7f6e740b0e10 2024-09-12T02:35:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.582+0000 7f6e727fc640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 0x7f6e6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.582+0000 7f6e79e29640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 0x7f6e6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.582+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f6e6408bd20 con 0x7f6e740b0e10 2024-09-12T02:35:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.583+0000 7f6e79e29640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 0x7f6e6006e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c000c00 tx=0x7f6e6c001e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.587+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e64019030 con 0x7f6e740b0e10 2024-09-12T02:35:08.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:08.788+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6e74070f80 con 0x7f6e740b0e10 2024-09-12T02:35:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.461+0000 7f6e727fc640 1 -- 172.21.15.119:0/2522942949 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f6e64010040 con 0x7f6e740b0e10 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 msgr2=0x7f6e6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 0x7f6e6006e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c000c00 tx=0x7f6e6c001e20 comp rx=0 tx=0).stop 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 msgr2=0x7f6e74156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e7415ec30 tx=0x7f6e6400f580 comp rx=0 tx=0).stop 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 shutdown_connections 2024-09-12T02:35:09.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6e6006be60 0x7f6e6006e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e740b0e10 0x7f6e74156860 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e740affb0 0x7f6e7414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 --2- 172.21.15.119:0/2522942949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c004390 0x7f6e7409ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 >> 172.21.15.119:0/2522942949 conn(0x7f6e740b79e0 msgr2=0x7f6e741621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 shutdown_connections 2024-09-12T02:35:09.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.463+0000 7f6e7c08d640 1 -- 172.21.15.119:0/2522942949 wait complete. 2024-09-12T02:35:09.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:35:09.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.581+0000 7f602eff6640 1 Processor -- start 2024-09-12T02:35:09.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.581+0000 7f602eff6640 1 -- start start 2024-09-12T02:35:09.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602eff6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6028067ae0 0x7f60280b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602eff6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028067ff0 con 0x7f60280adce0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602eff6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60280af390 con 0x7f602815e2e0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602eff6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f60280aec30 con 0x7f6028067ae0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602d593640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f60280adce0 0x7f60280ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58084/0 (socket says 172.21.15.119:58084) 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f602d593640 1 -- 172.21.15.119:0/1680766544 learned_addr learned my addr 172.21.15.119:0/1680766544 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f601ffff640 1 --2- 172.21.15.119:0/1680766544 >> v2:172.21.15.153:3300/0 conn(0x7f6028067ae0 0x7f60280b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582089690 0 0) 0x7f6028067ff0 con 0x7f60280adce0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.582+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6010003520 con 0x7f60280adce0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 381427615 0 0) 0x7f6010003520 con 0x7f60280adce0 2024-09-12T02:35:09.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 >> v2:172.21.15.153:3300/0 conn(0x7f6028067ae0 msgr2=0x7f60280b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 --2- 172.21.15.119:0/1680766544 >> v2:172.21.15.153:3300/0 conn(0x7f6028067ae0 0x7f60280b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 >> v1:172.21.15.153:6789/0 conn(0x7f602815e2e0 legacy=0x7f602815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280af670 con 0x7f60280adce0 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f60200019f0 con 0x7f60280adce0 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 >> v1:172.21.15.119:6789/0 conn(0x7f60280adce0 legacy=0x7f60280ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100039b0 0x7f6010003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6010004800 0x7f6010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 0x7f601000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f601000c030 con 0x7f60100051c0 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f601000c1e0 con 0x7f60100039b0 2024-09-12T02:35:09.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f601000c3e0 con 0x7f6010004800 2024-09-12T02:35:09.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 0x7f601000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602cd92640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100039b0 0x7f6010003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601ffff640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6010004800 0x7f6010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 -- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6010004800 msgr2=0x7f6010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6010004800 0x7f6010004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 -- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100039b0 msgr2=0x7f6010003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100039b0 0x7f6010003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602d593640 1 -- 172.21.15.119:0/1680766544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6010003520 con 0x7f60100051c0 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f601ffff640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6010004800 0x7f6010004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.583+0000 7f602cd92640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100039b0 0x7f6010003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f602d593640 1 -- 172.21.15.119:0/1680766544 reap_dead start 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f602d593640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 0x7f601000b9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f602000a860 tx=0x7f6010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39795d65b7e0efbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602000a480 con 0x7f60100051c0 2024-09-12T02:35:09.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602002f070 con 0x7f60100051c0 2024-09-12T02:35:09.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f601f7fe640 1 -- 172.21.15.119:0/1680766544 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602002bcc0 con 0x7f60100051c0 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f602eff6640 1 -- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 msgr2=0x7f601000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.584+0000 7f602eff6640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 0x7f601000b9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f602000a860 tx=0x7f6010005830 comp rx=0 tx=0).stop 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.585+0000 7f602eff6640 1 -- 172.21.15.119:0/1680766544 shutdown_connections 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.585+0000 7f602eff6640 1 --2- 172.21.15.119:0/1680766544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60100051c0 0x7f601000b9c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.585+0000 7f602eff6640 1 -- 172.21.15.119:0/1680766544 >> 172.21.15.119:0/1680766544 conn(0x7f6028073590 msgr2=0x7f602806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.585+0000 7f602eff6640 1 -- 172.21.15.119:0/1680766544 shutdown_connections 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.585+0000 7f602eff6640 1 -- 172.21.15.119:0/1680766544 wait complete. 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.586+0000 7f602eff6640 1 Processor -- start 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.586+0000 7f602eff6640 1 -- start start 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100051c0 0x7f60281f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60280c5b70 0x7f60280c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f602815e6c0 con 0x7f60280ce2f0 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60280afc30 con 0x7f60100051c0 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f60280b0150 con 0x7f60280c5b70 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58570/0 (socket says 172.21.15.119:58570) 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 -- 172.21.15.119:0/3226684061 learned_addr learned my addr 172.21.15.119:0/3226684061 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602cd92640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100051c0 0x7f60281f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f601ffff640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60280c5b70 0x7f60280c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 -- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60280c5b70 msgr2=0x7f60280c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60280c5b70 0x7f60280c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 -- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100051c0 msgr2=0x7f60281f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100051c0 0x7f60281f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 -- 172.21.15.119:0/3226684061 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280cf020 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602d593640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f602000a980 tx=0x7f60280af560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6020004d70 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602002b880 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60280cf300 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602002bc30 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.587+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60280cf8c0 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.588+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60280ae150 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.589+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6020034470 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.589+0000 7f601d7fa640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 0x7f601406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.589+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f60200aae60 con 0x7f60280ce2f0 2024-09-12T02:35:09.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.589+0000 7f602cd92640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 0x7f601406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.590+0000 7f602cd92640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 0x7f601406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6024000c00 tx=0x7f6024009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.593+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6020079070 con 0x7f60280ce2f0 2024-09-12T02:35:09.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:09.758+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f602806f3f0 con 0x7f60280ce2f0 2024-09-12T02:35:10.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.462+0000 7f601d7fa640 1 -- 172.21.15.119:0/3226684061 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f602007d370 con 0x7f60280ce2f0 2024-09-12T02:35:10.463 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:35:10.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.465+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 msgr2=0x7f601406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.465+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 0x7f601406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6024000c00 tx=0x7f6024009040 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.465+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 msgr2=0x7f60280ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.465+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f602000a980 tx=0x7f60280af560 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 shutdown_connections 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f601406be60 0x7f601406e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60280ce2f0 0x7f60280ce780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60280c5b70 0x7f60280c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 --2- 172.21.15.119:0/3226684061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60100051c0 0x7f60281f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 >> 172.21.15.119:0/3226684061 conn(0x7f6028073590 msgr2=0x7f602806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 shutdown_connections 2024-09-12T02:35:10.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.466+0000 7f602eff6640 1 -- 172.21.15.119:0/3226684061 wait complete. 2024-09-12T02:35:10.479 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:35:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.583+0000 7f88e1677640 1 Processor -- start 2024-09-12T02:35:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.583+0000 7f88e1677640 1 -- start start 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88e1677640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 0x7f88dc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88e1677640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88dc0cf160 0x7f88dc06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88e1677640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88dc0cf980 con 0x7f88dc161a20 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88e1677640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f88dc161e00 con 0x7f88dc0cf160 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88e1677640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f88dc06d050 con 0x7f88dc0d15f0 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88dc0cf160 0x7f88dc06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88dc0cf160 0x7f88dc06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58584/0 (socket says 172.21.15.119:58584) 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 -- 172.21.15.119:0/606954176 learned_addr learned my addr 172.21.15.119:0/606954176 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88da7fc640 1 --2- 172.21.15.119:0/606954176 >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 0x7f88dc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 -- 172.21.15.119:0/606954176 >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 msgr2=0x7f88dc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 --2- 172.21.15.119:0/606954176 >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 0x7f88dc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 -- 172.21.15.119:0/606954176 >> v1:172.21.15.153:6789/0 conn(0x7f88dc161a20 legacy=0x7f88dc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88db7fe640 1 -- 172.21.15.119:0/606954176 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc0cfc20 con 0x7f88dc0cf160 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.584+0000 7f88da7fc640 1 --2- 172.21.15.119:0/606954176 >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 0x7f88dc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.585+0000 7f88db7fe640 1 --2- 172.21.15.119:0/606954176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc0cf160 0x7f88dc06d810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0d4410 tx=0x7f88d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdcf75bea73f3da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.585+0000 7f88d9ffb640 1 -- 172.21.15.119:0/606954176 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4036070 con 0x7f88dc0cf160 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.585+0000 7f88d9ffb640 1 -- 172.21.15.119:0/606954176 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4031600 con 0x7f88dc0cf160 2024-09-12T02:35:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.585+0000 7f88d9ffb640 1 -- 172.21.15.119:0/606954176 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40319d0 con 0x7f88dc0cf160 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 -- 172.21.15.119:0/606954176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc0cf160 msgr2=0x7f88dc06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 --2- 172.21.15.119:0/606954176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc0cf160 0x7f88dc06d810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0d4410 tx=0x7f88d402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 -- 172.21.15.119:0/606954176 shutdown_connections 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 --2- 172.21.15.119:0/606954176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc0cf160 0x7f88dc06d810 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 --2- 172.21.15.119:0/606954176 >> v2:172.21.15.153:3300/0 conn(0x7f88dc0d15f0 0x7f88dc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 -- 172.21.15.119:0/606954176 >> 172.21.15.119:0/606954176 conn(0x7f88dc09d850 msgr2=0x7f88dc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 -- 172.21.15.119:0/606954176 shutdown_connections 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.586+0000 7f88e1677640 1 -- 172.21.15.119:0/606954176 wait complete. 2024-09-12T02:35:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.587+0000 7f88e1677640 1 Processor -- start 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.587+0000 7f88e1677640 1 -- start start 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88dc0cf160 0x7f88dc0b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88dc0d15f0 0x7f88dc0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc0b1040 con 0x7f88dc161a20 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc06d2f0 con 0x7f88dc0d15f0 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88e1677640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc0cf590 con 0x7f88dc0cf160 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58596/0 (socket says 172.21.15.119:58596) 2024-09-12T02:35:10.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 -- 172.21.15.119:0/4205837241 learned_addr learned my addr 172.21.15.119:0/4205837241 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88da7fc640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88dc0d15f0 0x7f88dc0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88daffd640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88dc0cf160 0x7f88dc0b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 -- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88dc0cf160 msgr2=0x7f88dc0b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88dc0cf160 0x7f88dc0b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 -- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88dc0d15f0 msgr2=0x7f88dc0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88dc0d15f0 0x7f88dc0b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 -- 172.21.15.119:0/4205837241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc1f41b0 con 0x7f88dc161a20 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.588+0000 7f88db7fe640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009f10 tx=0x7f88d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.589+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4036050 con 0x7f88dc161a20 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.589+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4042070 con 0x7f88dc161a20 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.589+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4009510 con 0x7f88dc161a20 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.589+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc0b5430 con 0x7f88dc161a20 2024-09-12T02:35:10.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.589+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc0b5c70 con 0x7f88dc161a20 2024-09-12T02:35:10.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.590+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88dc0cec20 con 0x7f88dc161a20 2024-09-12T02:35:10.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.590+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88d4007bd0 con 0x7f88dc161a20 2024-09-12T02:35:10.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.590+0000 7f88c37fe640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.591+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5749+0+0 (secure 0 0 0) 0x7f88d40abd00 con 0x7f88dc161a20 2024-09-12T02:35:10.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.591+0000 7f88daffd640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.591+0000 7f88daffd640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88cc006fd0 tx=0x7f88cc009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.595+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88dc0b5430 con 0x7f88dc161a20 2024-09-12T02:35:10.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:10.761+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88dc08c340 con 0x7f88dc161a20 2024-09-12T02:35:11.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.466+0000 7f88c37fe640 1 -- 172.21.15.119:0/4205837241 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f88d407a030 con 0x7f88dc161a20 2024-09-12T02:35:11.467 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 msgr2=0x7f88c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88cc006fd0 tx=0x7f88cc009060 comp rx=0 tx=0).stop 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 msgr2=0x7f88dc15e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009f10 tx=0x7f88d4004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 shutdown_connections 2024-09-12T02:35:11.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88dc161a20 0x7f88dc15e0e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88dc0d15f0 0x7f88dc0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 --2- 172.21.15.119:0/4205837241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88dc0cf160 0x7f88dc0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 >> 172.21.15.119:0/4205837241 conn(0x7f88dc09d850 msgr2=0x7f88dc15f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.469+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 shutdown_connections 2024-09-12T02:35:11.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.470+0000 7f88e1677640 1 -- 172.21.15.119:0/4205837241 wait complete. 2024-09-12T02:35:11.484 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:35:11.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.585+0000 7f10fc331640 1 Processor -- start 2024-09-12T02:35:11.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.585+0000 7f10fc331640 1 -- start start 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fc331640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10f4162e30 0x7f10f406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fc331640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f40cf280 0x7f10f40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fc331640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f415ff70 con 0x7f10f4162340 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fc331640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f10f406de90 con 0x7f10f4162e30 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fc331640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f10f4163270 con 0x7f10f40cf280 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10f98cc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10f4162e30 0x7f10f406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fa0cd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f10f4162340 0x7f10f4162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58100/0 (socket says 172.21.15.119:58100) 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.586+0000 7f10fa0cd640 1 -- 172.21.15.119:0/1556560557 learned_addr learned my addr 172.21.15.119:0/1556560557 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10fa8ce640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f40cf280 0x7f10f40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f98cc640 1 -- 172.21.15.119:0/1556560557 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f40cf280 msgr2=0x7f10f40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f98cc640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f40cf280 0x7f10f40d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f98cc640 1 -- 172.21.15.119:0/1556560557 >> v1:172.21.15.119:6789/0 conn(0x7f10f4162340 legacy=0x7f10f4162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f90cb640 1 -- 172.21.15.119:0/1556560557 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839942243 0 0) 0x7f10f415ff70 con 0x7f10f4162340 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f98cc640 1 -- 172.21.15.119:0/1556560557 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f40d4d10 con 0x7f10f4162e30 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.587+0000 7f10f98cc640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4162e30 0x7f10f406d740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009790 tx=0x7f10e402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e89e36aa33e4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10f90cb640 1 -- 172.21.15.119:0/1556560557 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4037070 con 0x7f10f4162e30 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10f90cb640 1 -- 172.21.15.119:0/1556560557 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e402ae50 con 0x7f10f4162e30 2024-09-12T02:35:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10f90cb640 1 -- 172.21.15.119:0/1556560557 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4032660 con 0x7f10f4162e30 2024-09-12T02:35:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 -- 172.21.15.119:0/1556560557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4162e30 msgr2=0x7f10f406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4162e30 0x7f10f406d740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009790 tx=0x7f10e402a100 comp rx=0 tx=0).stop 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 -- 172.21.15.119:0/1556560557 shutdown_connections 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f40cf280 0x7f10f40d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 --2- 172.21.15.119:0/1556560557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4162e30 0x7f10f406d740 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 -- 172.21.15.119:0/1556560557 >> 172.21.15.119:0/1556560557 conn(0x7f10f408bfc0 msgr2=0x7f10f40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 -- 172.21.15.119:0/1556560557 shutdown_connections 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.588+0000 7f10fc331640 1 -- 172.21.15.119:0/1556560557 wait complete. 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.589+0000 7f10fc331640 1 Processor -- start 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.589+0000 7f10fc331640 1 -- start start 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f4162340 0x7f10f41f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f4162e30 0x7f10f415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40cf710 con 0x7f10f40cf280 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40d2470 con 0x7f10f4162e30 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fc331640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f10f40d52d0 con 0x7f10f4162340 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58616/0 (socket says 172.21.15.119:58616) 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 -- 172.21.15.119:0/1309086432 learned_addr learned my addr 172.21.15.119:0/1309086432 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa8ce640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f4162e30 0x7f10f415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10f98cc640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f4162340 0x7f10f41f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 -- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f4162340 msgr2=0x7f10f41f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f4162340 0x7f10f41f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 -- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f4162e30 msgr2=0x7f10f415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f4162e30 0x7f10f415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.590+0000 7f10fa0cd640 1 -- 172.21.15.119:0/1309086432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f41f8350 con 0x7f10f40cf280 2024-09-12T02:35:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10fa0cd640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c4d0 tx=0x7f10f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0018070 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f0007500 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0004a20 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f41f8630 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.591+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f40cb7a0 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.592+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f40cca70 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.592+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10f001b070 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.593+0000 7f10eaffd640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 0x7f10d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.593+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f10f0089fe0 con 0x7f10f40cf280 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.593+0000 7f10f98cc640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 0x7f10d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.593+0000 7f10f98cc640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 0x7f10d806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e4034000 tx=0x7f10e402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.597+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10f0058b90 con 0x7f10f40cf280 2024-09-12T02:35:11.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.761+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f10f408e640 con 0x7f10f40cf280 2024-09-12T02:35:11.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.764+0000 7f10eaffd640 1 -- 172.21.15.119:0/1309086432 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f10f0058490 con 0x7f10f40cf280 2024-09-12T02:35:11.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 msgr2=0x7f10d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 0x7f10d806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e4034000 tx=0x7f10e402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 msgr2=0x7f10f41f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c4d0 tx=0x7f10f000c990 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 shutdown_connections 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f10d806be30 0x7f10d806e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f4162e30 0x7f10f415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f4162340 0x7f10f41f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 --2- 172.21.15.119:0/1309086432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40cf280 0x7f10f41f3a30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 >> 172.21.15.119:0/1309086432 conn(0x7f10f408bfc0 msgr2=0x7f10f415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 shutdown_connections 2024-09-12T02:35:11.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.767+0000 7f10fc331640 1 -- 172.21.15.119:0/1309086432 wait complete. 2024-09-12T02:35:11.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-09-12T02:35:11.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.876+0000 7f7cfe065640 1 Processor -- start 2024-09-12T02:35:11.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.876+0000 7f7cfe065640 1 -- start start 2024-09-12T02:35:11.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.876+0000 7f7cfe065640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cf8161c80 0x7f7cf806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.876+0000 7f7cfe065640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80b6680 0x7f7cf80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cfe065640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf806e870 con 0x7f7cf8162060 2024-09-12T02:35:11.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cfe065640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf806d9f0 con 0x7f7cf8161c80 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cfe065640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf806dcd0 con 0x7f7cf80b6680 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cf8161c80 0x7f7cf806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7cf8162060 0x7f7cf80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58114/0 (socket says 172.21.15.119:58114) 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf6ffd640 1 -- 172.21.15.119:0/2360854045 learned_addr learned my addr 172.21.15.119:0/2360854045 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cf8161c80 0x7f7cf806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58618/0 (socket says 172.21.15.119:58618) 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf7fff640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80b6680 0x7f7cf80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 -- 172.21.15.119:0/2360854045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80b6680 msgr2=0x7f7cf80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80b6680 0x7f7cf80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 -- 172.21.15.119:0/2360854045 >> v1:172.21.15.119:6789/0 conn(0x7f7cf8162060 legacy=0x7f7cf80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf77fe640 1 -- 172.21.15.119:0/2360854045 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf806dfb0 con 0x7f7cf8161c80 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.877+0000 7f7cf67fc640 1 -- 172.21.15.119:0/2360854045 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068619319 0 0) 0x7f7cec001110 con 0x7f7cf8162060 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cf77fe640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf806e330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097a0 tx=0x7f7ce802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424ca2ace16695f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cf67fc640 1 -- 172.21.15.119:0/2360854045 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8037070 con 0x7f7cf8161c80 2024-09-12T02:35:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cf67fc640 1 -- 172.21.15.119:0/2360854045 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8032440 con 0x7f7cf8161c80 2024-09-12T02:35:11.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cf67fc640 1 -- 172.21.15.119:0/2360854045 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8032810 con 0x7f7cf8161c80 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 -- 172.21.15.119:0/2360854045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 msgr2=0x7f7cf806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf806e330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097a0 tx=0x7f7ce802a180 comp rx=0 tx=0).stop 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 -- 172.21.15.119:0/2360854045 shutdown_connections 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80b6680 0x7f7cf80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 --2- 172.21.15.119:0/2360854045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf806e330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 -- 172.21.15.119:0/2360854045 >> 172.21.15.119:0/2360854045 conn(0x7f7cf80d44f0 msgr2=0x7f7cf80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 -- 172.21.15.119:0/2360854045 shutdown_connections 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.878+0000 7f7cfe065640 1 -- 172.21.15.119:0/2360854045 wait complete. 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.880+0000 7f7cfe065640 1 Processor -- start 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.880+0000 7f7cfe065640 1 -- start start 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.880+0000 7f7cfe065640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80b6680 0x7f7cf8155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf8162060 0x7f7cf80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80b6cb0 con 0x7f7cf8161c80 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80b6b30 con 0x7f7cf80b6680 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80cf720 con 0x7f7cf8162060 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58622/0 (socket says 172.21.15.119:58622) 2024-09-12T02:35:11.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 -- 172.21.15.119:0/82539004 learned_addr learned my addr 172.21.15.119:0/82539004 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf77fe640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80b6680 0x7f7cf8155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf7fff640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf8162060 0x7f7cf80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 -- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf8162060 msgr2=0x7f7cf80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf8162060 0x7f7cf80b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 -- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80b6680 msgr2=0x7f7cf8155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80b6680 0x7f7cf8155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 -- 172.21.15.119:0/82539004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf80b8590 con 0x7f7cf8161c80 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cf6ffd640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c410 tx=0x7f7cec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0074e0 con 0x7f7cf8161c80 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec0047e0 con 0x7f7cf8161c80 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf80b8870 con 0x7f7cf8161c80 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec004bd0 con 0x7f7cf8161c80 2024-09-12T02:35:11.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.881+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf80b8e30 con 0x7f7cf8161c80 2024-09-12T02:35:11.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.882+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf80d1d30 con 0x7f7cf8161c80 2024-09-12T02:35:11.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.883+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cec011070 con 0x7f7cf8161c80 2024-09-12T02:35:11.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.883+0000 7f7cdffff640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 0x7f7ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:11.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.883+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f7cec08a780 con 0x7f7cf8161c80 2024-09-12T02:35:11.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.883+0000 7f7cf77fe640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 0x7f7ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:11.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.884+0000 7f7cf77fe640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 0x7f7ce406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8034000 tx=0x7f7ce802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:11.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:11.887+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cf806e870 con 0x7f7cf8161c80 2024-09-12T02:35:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.121+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7f7cf80cf1c0 con 0x7f7cf8161c80 2024-09-12T02:35:12.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.467+0000 7f7cdffff640 1 -- 172.21.15.119:0/82539004 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v91) ==== 123+0+0 (secure 0 0 0) 0x7f7cec058ce0 con 0x7f7cf8161c80 2024-09-12T02:35:12.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 msgr2=0x7f7ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:12.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 0x7f7ce406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8034000 tx=0x7f7ce802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 msgr2=0x7f7cf80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c410 tx=0x7f7cec00c8d0 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 shutdown_connections 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f7ce406be30 0x7f7ce406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf8162060 0x7f7cf80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf8161c80 0x7f7cf80cdd40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 --2- 172.21.15.119:0/82539004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80b6680 0x7f7cf8155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 >> 172.21.15.119:0/82539004 conn(0x7f7cf80d44f0 msgr2=0x7f7cf815fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 shutdown_connections 2024-09-12T02:35:12.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:12.470+0000 7f7cfe065640 1 -- 172.21.15.119:0/82539004 wait complete. 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_flush.TestFlush) ... ERROR 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner: 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T02:35:12.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_flush.py", line 39, in test_flush 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T02:35:12.485 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner: 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:Ran 1 test in 36.871s 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner: 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner: 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-09-12T02:35:12.486 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_flush.py", line 39, in test_flush 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T02:35:12.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T02:35:12.488 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T02:35:12.488 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T02:35:12.488 INFO:tasks.cephfs_test_runner: 2024-09-12T02:35:12.488 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-09-12T02:35:12.750 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=33e9f359d48241d08072ed89e0ac0b63 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-09-12T02:35:12.752 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T02:35:12.765 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:35:12.803 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:35:12.804 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:12.804 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:12.826 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20685 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:12.826 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:35:12.826 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:12.883 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20685 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:12.884 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:35:12.884 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:12.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17709 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:12.904 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T02:35:12.904 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:12.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17709 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:12.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.963 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:35:12.980 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:35:12.980 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:35:12.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:13.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.048 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:13.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-12T02:35:13.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.226 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-12T02:35:13.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-12T02:35:13.311 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2024-09-12T02:35:13.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:13.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.313 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:35:13.331 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:35:13.332 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:35:13.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:35:13.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:35:13.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T02:35:13.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.576 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T02:35:13.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T02:35:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-12T02:35:13.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:13.662 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:35:13.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:35:13.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:13.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.770+0000 7f8e880ba640 1 Processor -- start 2024-09-12T02:35:13.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.770+0000 7f8e880ba640 1 -- start start 2024-09-12T02:35:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e880ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e8006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e880ba640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e8006f700 0x7f8e8015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e880ba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800cdbe0 con 0x7f8e8015b300 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e880ba640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8006fb50 con 0x7f8e8006f700 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e880ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800728a0 con 0x7f8e80072d30 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e85e56640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8e8015b300 0x7f8e800cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58118/0 (socket says 172.21.15.119:58118) 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.771+0000 7f8e85e56640 1 -- 172.21.15.119:0/3469129944 learned_addr learned my addr 172.21.15.119:0/3469129944 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505734809 0 0) 0x7f8e800cdbe0 con 0x7f8e8015b300 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e6c003520 con 0x7f8e8015b300 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e86657640 1 --2- 172.21.15.119:0/3469129944 >> v2:172.21.15.153:3300/0 conn(0x7f8e8006f700 0x7f8e8015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85655640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e8006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3899932405 0 0) 0x7f8e6c003520 con 0x7f8e8015b300 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 msgr2=0x7f8e8006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e8006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 >> v2:172.21.15.153:3300/0 conn(0x7f8e8006f700 msgr2=0x7f8e8015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 --2- 172.21.15.119:0/3469129944 >> v2:172.21.15.153:3300/0 conn(0x7f8e8006f700 0x7f8e8015b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800cd900 con 0x7f8e8015b300 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f8e7c001670 con 0x7f8e8015b300 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 >> v1:172.21.15.119:6789/0 conn(0x7f8e8015b300 legacy=0x7f8e800cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e6c004800 0x7f8e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8006fb50 con 0x7f8e6c0039b0 2024-09-12T02:35:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800728a0 con 0x7f8e6c004800 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c00baa0 con 0x7f8e80072d30 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e86657640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85655640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e6c004800 0x7f8e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 -- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 msgr2=0x7f8e6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80072d30 0x7f8e6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 -- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e6c004800 msgr2=0x7f8e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e6c004800 0x7f8e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.772+0000 7f8e85e56640 1 -- 172.21.15.119:0/3469129944 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c003520 con 0x7f8e6c0039b0 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.773+0000 7f8e85e56640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e6c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c001eb0 tx=0x7f8e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d31668db7f94dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.773+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c007d70 con 0x7f8e6c0039b0 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.773+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0058d0 con 0x7f8e6c0039b0 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.773+0000 7f8e84e54640 1 -- 172.21.15.119:0/3469129944 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c005ca0 con 0x7f8e6c0039b0 2024-09-12T02:35:13.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 -- 172.21.15.119:0/3469129944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 msgr2=0x7f8e6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 --2- 172.21.15.119:0/3469129944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e6c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c001eb0 tx=0x7f8e6c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e86657640 1 -- 172.21.15.119:0/3469129944 reap_dead start 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 -- 172.21.15.119:0/3469129944 shutdown_connections 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 -- 172.21.15.119:0/3469129944 >> 172.21.15.119:0/3469129944 conn(0x7f8e80067d70 msgr2=0x7f8e8006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 -- 172.21.15.119:0/3469129944 shutdown_connections 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.774+0000 7f8e880ba640 1 -- 172.21.15.119:0/3469129944 wait complete. 2024-09-12T02:35:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.775+0000 7f8e880ba640 1 Processor -- start 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.775+0000 7f8e880ba640 1 -- start start 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e801583d0 0x7f8e80159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80150ba0 0x7f8e80151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800cd5c0 con 0x7f8e6c0039b0 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e80072530 con 0x7f8e801583d0 2024-09-12T02:35:13.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800cffe0 con 0x7f8e80150ba0 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58634/0 (socket says 172.21.15.119:58634) 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 -- 172.21.15.119:0/2110702455 learned_addr learned my addr 172.21.15.119:0/2110702455 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85655640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e801583d0 0x7f8e80159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e86657640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80150ba0 0x7f8e80151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 -- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80150ba0 msgr2=0x7f8e80151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80150ba0 0x7f8e80151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 -- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e801583d0 msgr2=0x7f8e80159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e801583d0 0x7f8e80159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 -- 172.21.15.119:0/2110702455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e80155290 con 0x7f8e6c0039b0 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e85e56640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c001050 tx=0x7f8e7c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c007280 con 0x7f8e6c0039b0 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c043070 con 0x7f8e6c0039b0 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e80155550 con 0x7f8e6c0039b0 2024-09-12T02:35:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.776+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c007660 con 0x7f8e6c0039b0 2024-09-12T02:35:13.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.777+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e80155b10 con 0x7f8e6c0039b0 2024-09-12T02:35:13.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.777+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8006f1c0 con 0x7f8e6c0039b0 2024-09-12T02:35:13.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.778+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e7c03e420 con 0x7f8e6c0039b0 2024-09-12T02:35:13.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.779+0000 7f8e767fc640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 0x7f8e6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.779+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f8e7c0aade0 con 0x7f8e6c0039b0 2024-09-12T02:35:13.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.779+0000 7f8e85655640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 0x7f8e6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.779+0000 7f8e85655640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 0x7f8e6406e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e800adae0 tx=0x7f8e70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.783+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e7c007800 con 0x7f8e6c0039b0 2024-09-12T02:35:13.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.945+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e800cd150 con 0x7f8e6406be60 2024-09-12T02:35:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.946+0000 7f8e767fc640 1 -- 172.21.15.119:0/2110702455 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13488 (secure 0 0 0) 0x7f8e800cd150 con 0x7f8e6406be60 2024-09-12T02:35:13.947 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:13.948 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:13.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 msgr2=0x7f8e6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 0x7f8e6406e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e800adae0 tx=0x7f8e70008040 comp rx=0 tx=0).stop 2024-09-12T02:35:13.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 msgr2=0x7f8e801f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c001050 tx=0x7f8e7c000fe0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 shutdown_connections 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f8e6406be60 0x7f8e6406e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e80150ba0 0x7f8e80151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e801583d0 0x7f8e80159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 --2- 172.21.15.119:0/2110702455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6c0039b0 0x7f8e801f87f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 >> 172.21.15.119:0/2110702455 conn(0x7f8e80067d70 msgr2=0x7f8e8015b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 shutdown_connections 2024-09-12T02:35:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:13.948+0000 7f8e880ba640 1 -- 172.21.15.119:0/2110702455 wait complete. 2024-09-12T02:35:13.960 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-12T02:35:13.194451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221072,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4972544,"data_stored":2824343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001209"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T02:35:08.464237+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:35:08.464237+0000","last_peered":"2024-09-12T02:35:08.464237+0000","last_clean":"2024-09-12T02:35:08.464237+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:35:08.464237+0000","last_undegraded":"2024-09-12T02:35:08.464237+0000","last_fullsized":"2024-09-12T02:35:08.464237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476758,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":807062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":202762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476757,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":203254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":203232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":196267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":786579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":210185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:13.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:14.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 Processor -- start 2024-09-12T02:35:14.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 -- start start 2024-09-12T02:35:14.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12ac162060 0x7f12ac0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac0b64b0 0x7f12ac0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12ac06d9f0 con 0x7f12ac161c80 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f12ac06dcd0 con 0x7f12ac162060 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.059+0000 7f12b2d7f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac06dfb0 con 0x7f12ac0b64b0 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12ac162060 0x7f12ac0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12ac162060 0x7f12ac0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58644/0 (socket says 172.21.15.119:58644) 2024-09-12T02:35:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 -- 172.21.15.119:0/2604338419 learned_addr learned my addr 172.21.15.119:0/2604338419 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12b131c640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac0b64b0 0x7f12ac0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 -- 172.21.15.119:0/2604338419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac0b64b0 msgr2=0x7f12ac0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac0b64b0 0x7f12ac0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 -- 172.21.15.119:0/2604338419 >> v1:172.21.15.153:6789/0 conn(0x7f12ac161c80 legacy=0x7f12ac06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.060+0000 7f12abfff640 1 -- 172.21.15.119:0/2604338419 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac0d01f0 con 0x7f12ac162060 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12abfff640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac162060 0x7f12ac0b5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1298009870 tx=0x7f129802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38489bc7ecb51cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12ab7fe640 1 -- 172.21.15.119:0/2604338419 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298037070 con 0x7f12ac162060 2024-09-12T02:35:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12ab7fe640 1 -- 172.21.15.119:0/2604338419 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298032440 con 0x7f12ac162060 2024-09-12T02:35:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12ab7fe640 1 -- 172.21.15.119:0/2604338419 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298032810 con 0x7f12ac162060 2024-09-12T02:35:14.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 -- 172.21.15.119:0/2604338419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac162060 msgr2=0x7f12ac0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac162060 0x7f12ac0b5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1298009870 tx=0x7f129802a210 comp rx=0 tx=0).stop 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 -- 172.21.15.119:0/2604338419 shutdown_connections 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac0b64b0 0x7f12ac0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/2604338419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac162060 0x7f12ac0b5f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 -- 172.21.15.119:0/2604338419 >> 172.21.15.119:0/2604338419 conn(0x7f12ac0d44f0 msgr2=0x7f12ac0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 -- 172.21.15.119:0/2604338419 shutdown_connections 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.061+0000 7f12b2d7f640 1 -- 172.21.15.119:0/2604338419 wait complete. 2024-09-12T02:35:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 Processor -- start 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 -- start start 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12ac161c80 0x7f12ac156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac162060 0x7f12ac156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0cf360 con 0x7f12ac0b64b0 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0cf1e0 con 0x7f12ac161c80 2024-09-12T02:35:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.063+0000 7f12b2d7f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac0cf4e0 con 0x7f12ac162060 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58648/0 (socket says 172.21.15.119:58648) 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 -- 172.21.15.119:0/4089155023 learned_addr learned my addr 172.21.15.119:0/4089155023 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12abfff640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12ac161c80 0x7f12ac156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b131c640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac162060 0x7f12ac156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 -- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac162060 msgr2=0x7f12ac156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac162060 0x7f12ac156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 -- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12ac161c80 msgr2=0x7f12ac156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12ac161c80 0x7f12ac156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 -- 172.21.15.119:0/4089155023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac0cc120 con 0x7f12ac0b64b0 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b0b1b640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c430 tx=0x7f12a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0011790 con 0x7f12ac0b64b0 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0017070 con 0x7f12ac0b64b0 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac0cc400 con 0x7f12ac0b64b0 2024-09-12T02:35:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0011bb0 con 0x7f12ac0b64b0 2024-09-12T02:35:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.064+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac0cc9c0 con 0x7f12ac0b64b0 2024-09-12T02:35:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.065+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac0b5f70 con 0x7f12ac0b64b0 2024-09-12T02:35:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.066+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12a001c460 con 0x7f12ac0b64b0 2024-09-12T02:35:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.066+0000 7f12a97fa640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 0x7f129006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.066+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f12a008aa40 con 0x7f12ac0b64b0 2024-09-12T02:35:14.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.066+0000 7f12abfff640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 0x7f129006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.067+0000 7f12abfff640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 0x7f129006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f129802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.071+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12a0058fa0 con 0x7f12ac0b64b0 2024-09-12T02:35:14.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.234+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12ac0d1840 con 0x7f129006be30 2024-09-12T02:35:14.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.235+0000 7f12a97fa640 1 -- 172.21.15.119:0/4089155023 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13488 (secure 0 0 0) 0x7f12ac0d1840 con 0x7f129006be30 2024-09-12T02:35:14.236 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:14.236 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:14.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 msgr2=0x7f129006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 0x7f129006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f129802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:14.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 msgr2=0x7f12ac155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c430 tx=0x7f12a000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 shutdown_connections 2024-09-12T02:35:14.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f129006be30 0x7f129006e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12ac162060 0x7f12ac156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12ac161c80 0x7f12ac156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 --2- 172.21.15.119:0/4089155023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac0b64b0 0x7f12ac155910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 >> 172.21.15.119:0/4089155023 conn(0x7f12ac0d44f0 msgr2=0x7f12ac0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 shutdown_connections 2024-09-12T02:35:14.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.237+0000 7f12b2d7f640 1 -- 172.21.15.119:0/4089155023 wait complete. 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-12T02:35:13.194451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221072,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4972544,"data_stored":2824343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001209"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T02:35:08.464237+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:35:08.464237+0000","last_peered":"2024-09-12T02:35:08.464237+0000","last_clean":"2024-09-12T02:35:08.464237+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:35:08.464237+0000","last_undegraded":"2024-09-12T02:35:08.464237+0000","last_fullsized":"2024-09-12T02:35:08.464237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476758,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":807062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":202762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476757,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":203254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":203232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":196267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":786579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":210185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:14.249 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:35:14.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:14.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.346+0000 7efdcdd31640 1 Processor -- start 2024-09-12T02:35:14.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.346+0000 7efdcdd31640 1 -- start start 2024-09-12T02:35:14.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdcdd31640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efdc815e750 0x7efdc80b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdcdd31640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc80b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdcdd31640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc809ac80 con 0x7efdc80b47a0 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdcdd31640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efdc815eb30 con 0x7efdc815e750 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdcdd31640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efdc809aa30 con 0x7efdc80ae240 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdc6ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc80b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdc77fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efdc815e750 0x7efdc80b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdc7fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efdc80b47a0 0x7efdc80b0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:57164/0 (socket says 172.21.15.119:57164) 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.347+0000 7efdc7fff640 1 -- 172.21.15.119:0/2476677250 learned_addr learned my addr 172.21.15.119:0/2476677250 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc77fe640 1 -- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 msgr2=0x7efdc80b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc77fe640 1 --2- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc80b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc77fe640 1 -- 172.21.15.119:0/2476677250 >> v1:172.21.15.153:6789/0 conn(0x7efdc80b47a0 legacy=0x7efdc80b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc77fe640 1 -- 172.21.15.119:0/2476677250 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc80b2990 con 0x7efdc815e750 2024-09-12T02:35:14.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc77fe640 1 --2- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc80b0700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68276c74c7e6aa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.348+0000 7efdc67fc640 1 -- 172.21.15.119:0/2476677250 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8037070 con 0x7efdc815e750 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdc67fc640 1 -- 172.21.15.119:0/2476677250 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb802ae50 con 0x7efdc815e750 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdc67fc640 1 -- 172.21.15.119:0/2476677250 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032660 con 0x7efdc815e750 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 -- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 msgr2=0x7efdc80b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc80b0700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802a100 comp rx=0 tx=0).stop 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 -- 172.21.15.119:0/2476677250 shutdown_connections 2024-09-12T02:35:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc80b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2476677250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc80b0700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 -- 172.21.15.119:0/2476677250 >> 172.21.15.119:0/2476677250 conn(0x7efdc8073490 msgr2=0x7efdc80b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 -- 172.21.15.119:0/2476677250 shutdown_connections 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.349+0000 7efdcdd31640 1 -- 172.21.15.119:0/2476677250 wait complete. 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.350+0000 7efdcdd31640 1 Processor -- start 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.350+0000 7efdcdd31640 1 -- start start 2024-09-12T02:35:14.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc81f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efdc80ae800 con 0x7efdc80b47a0 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efdc80ae680 con 0x7efdc815e750 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdcdd31640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efdc80b5f60 con 0x7efdc80ae240 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdc6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdc6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58662/0 (socket says 172.21.15.119:58662) 2024-09-12T02:35:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdc6ffd640 1 -- 172.21.15.119:0/2416518317 learned_addr learned my addr 172.21.15.119:0/2416518317 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdc7fff640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.351+0000 7efdc77fe640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc81f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 -- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 msgr2=0x7efdc81f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc81f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 -- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 msgr2=0x7efdc814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc814e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 -- 172.21.15.119:0/2416518317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc81e3d00 con 0x7efdc80b47a0 2024-09-12T02:35:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc7fff640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdc6ffd640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e9e0 tx=0x7efdb000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0017070 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb000c9d0 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc81f4e50 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000cdc0 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.352+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc81f7c50 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.353+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc80b6580 con 0x7efdc80b47a0 2024-09-12T02:35:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.353+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdb001a070 con 0x7efdc80b47a0 2024-09-12T02:35:14.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.354+0000 7efdbffff640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.354+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7efdb008ade0 con 0x7efdc80b47a0 2024-09-12T02:35:14.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.354+0000 7efdc77fe640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.354+0000 7efdc77fe640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdb8034000 tx=0x7efdb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.358+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb0059880 con 0x7efdc80b47a0 2024-09-12T02:35:14.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.521+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efdc80b1ac0 con 0x7efda806be30 2024-09-12T02:35:14.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.522+0000 7efdbffff640 1 -- 172.21.15.119:0/2416518317 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13488 (secure 0 0 0) 0x7efdb80454c0 con 0x7efda806be30 2024-09-12T02:35:14.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:14.527 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:14.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 msgr2=0x7efda806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdb8034000 tx=0x7efdb802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:14.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 msgr2=0x7efdc81edd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e9e0 tx=0x7efdb000eea0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 shutdown_connections 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc815e750 0x7efdc814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc80b47a0 0x7efdc81edd70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 --2- 172.21.15.119:0/2416518317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc80ae240 0x7efdc81f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 >> 172.21.15.119:0/2416518317 conn(0x7efdc8073490 msgr2=0x7efdc80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 shutdown_connections 2024-09-12T02:35:14.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.524+0000 7efdcdd31640 1 -- 172.21.15.119:0/2416518317 wait complete. 2024-09-12T02:35:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-12T02:35:13.194451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221072,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4972544,"data_stored":2824343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001209"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T02:35:08.464237+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:35:08.464237+0000","last_peered":"2024-09-12T02:35:08.464237+0000","last_clean":"2024-09-12T02:35:08.464237+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:35:08.464237+0000","last_undegraded":"2024-09-12T02:35:08.464237+0000","last_fullsized":"2024-09-12T02:35:08.464237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476758,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":807062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":202762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476757,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":203254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":203232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":196267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":786579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":210185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:14.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:14.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.634+0000 7f67b756d640 1 Processor -- start 2024-09-12T02:35:14.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.634+0000 7f67b756d640 1 -- start start 2024-09-12T02:35:14.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b756d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b00d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b756d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67b00ae550 0x7f67b00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b756d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b006cb30 con 0x7f67b0147360 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b756d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f67b006bfb0 con 0x7f67b00ae550 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b756d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67b006c290 con 0x7f67b00d04a0 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b5b0a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67b00ae550 0x7f67b00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b5b0a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67b00ae550 0x7f67b00ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58678/0 (socket says 172.21.15.119:58678) 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.635+0000 7f67b5b0a640 1 -- 172.21.15.119:0/3822126539 learned_addr learned my addr 172.21.15.119:0/3822126539 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:14.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b4b08640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b00d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b5b0a640 1 -- 172.21.15.119:0/3822126539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 msgr2=0x7f67b00d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b5b0a640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b00d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b5b0a640 1 -- 172.21.15.119:0/3822126539 >> v1:172.21.15.153:6789/0 conn(0x7f67b0147360 legacy=0x7f67b0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b5b0a640 1 -- 172.21.15.119:0/3822126539 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b006c570 con 0x7f67b00ae550 2024-09-12T02:35:14.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67b5b0a640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00ae980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009e50 tx=0x7f67a802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502ea9108e01a91d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.636+0000 7f67a7fff640 1 -- 172.21.15.119:0/3822126539 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8036070 con 0x7f67b00ae550 2024-09-12T02:35:14.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67a7fff640 1 -- 172.21.15.119:0/3822126539 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a8031600 con 0x7f67b00ae550 2024-09-12T02:35:14.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67a7fff640 1 -- 172.21.15.119:0/3822126539 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a80319d0 con 0x7f67b00ae550 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 -- 172.21.15.119:0/3822126539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 msgr2=0x7f67b00ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00ae980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009e50 tx=0x7f67a802a630 comp rx=0 tx=0).stop 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 -- 172.21.15.119:0/3822126539 shutdown_connections 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00ae980 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 --2- 172.21.15.119:0/3822126539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b00d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 -- 172.21.15.119:0/3822126539 >> 172.21.15.119:0/3822126539 conn(0x7f67b00b2f40 msgr2=0x7f67b00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 -- 172.21.15.119:0/3822126539 shutdown_connections 2024-09-12T02:35:14.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.637+0000 7f67b756d640 1 -- 172.21.15.119:0/3822126539 wait complete. 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.638+0000 7f67b756d640 1 Processor -- start 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.638+0000 7f67b756d640 1 -- start start 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b01385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0147360 0x7f67b0144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0070fa0 con 0x7f67b00ae550 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67b00d0e20 con 0x7f67b0147360 2024-09-12T02:35:14.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b756d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67b006bc10 con 0x7f67b00d04a0 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58680/0 (socket says 172.21.15.119:58680) 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 -- 172.21.15.119:0/4136997657 learned_addr learned my addr 172.21.15.119:0/4136997657 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 -- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 msgr2=0x7f67b01385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b01385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 -- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0147360 msgr2=0x7f67b0144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0147360 0x7f67b0144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.639+0000 7f67b5309640 1 -- 172.21.15.119:0/4136997657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b0142f40 con 0x7f67b00ae550 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67b5309640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b3f0 tx=0x7f67ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac015020 con 0x7f67b00ae550 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac011830 con 0x7f67b00ae550 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac011c20 con 0x7f67b00ae550 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b00b6010 con 0x7f67b00ae550 2024-09-12T02:35:14.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.640+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b0143220 con 0x7f67b00ae550 2024-09-12T02:35:14.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.641+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b0145780 con 0x7f67b00ae550 2024-09-12T02:35:14.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.641+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67ac018020 con 0x7f67b00ae550 2024-09-12T02:35:14.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.642+0000 7f67a5ffb640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.642+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f67ac08a900 con 0x7f67b00ae550 2024-09-12T02:35:14.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.642+0000 7f67b4b08640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.642+0000 7f67b4b08640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.646+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b0145780 con 0x7f67b00ae550 2024-09-12T02:35:14.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.813+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67b00d08e0 con 0x7f67b00ae550 2024-09-12T02:35:14.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.814+0000 7f67a5ffb640 1 -- 172.21.15.119:0/4136997657 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13367 (secure 0 0 0) 0x7f67ac01f030 con 0x7f67b00ae550 2024-09-12T02:35:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:14.819 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":43,"fsid":"3a2846d1-7a08-4c1c-a77f-ac792ab98e22","created":"2024-09-12T02:33:37.161753+0000","modified":"2024-09-12T02:35:11.463804+0000","last_up_change":"2024-09-12T02:33:49.363803+0000","last_in_change":"2024-09-12T02:33:39.266930+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:33:49.207672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a91ed7a9-938a-43ca-b627-ac0aa39c7633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6809","nonce":323475018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6811","nonce":323475018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6815","nonce":323475018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":323475018},{"type":"v1","addr":"172.21.15.119:6813","nonce":323475018}]},"public_addr":"172.21.15.119:6809/323475018","cluster_addr":"172.21.15.119:6811/323475018","heartbeat_back_addr":"172.21.15.119:6815/323475018","heartbeat_front_addr":"172.21.15.119:6813/323475018","state":["exists","up"]},{"osd":1,"uuid":"7d317538-5bab-438c-9e90-e32d83cc5ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6817","nonce":1265598191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6819","nonce":1265598191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6823","nonce":1265598191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1265598191},{"type":"v1","addr":"172.21.15.119:6821","nonce":1265598191}]},"public_addr":"172.21.15.119:6817/1265598191","cluster_addr":"172.21.15.119:6819/1265598191","heartbeat_back_addr":"172.21.15.119:6823/1265598191","heartbeat_front_addr":"172.21.15.119:6821/1265598191","state":["exists","up"]},{"osd":2,"uuid":"55f338f1-932a-4726-be33-968511cfb4ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6801","nonce":2688916930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6803","nonce":2688916930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6807","nonce":2688916930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2688916930},{"type":"v1","addr":"172.21.15.119:6805","nonce":2688916930}]},"public_addr":"172.21.15.119:6801/2688916930","cluster_addr":"172.21.15.119:6803/2688916930","heartbeat_back_addr":"172.21.15.119:6807/2688916930","heartbeat_front_addr":"172.21.15.119:6805/2688916930","state":["exists","up"]},{"osd":3,"uuid":"fcdfc1db-96d2-44b6-8048-f5ba1843df72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6825","nonce":2158673929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6827","nonce":2158673929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6831","nonce":2158673929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2158673929},{"type":"v1","addr":"172.21.15.119:6829","nonce":2158673929}]},"public_addr":"172.21.15.119:6825/2158673929","cluster_addr":"172.21.15.119:6827/2158673929","heartbeat_back_addr":"172.21.15.119:6831/2158673929","heartbeat_front_addr":"172.21.15.119:6829/2158673929","state":["exists","up"]},{"osd":4,"uuid":"7d0c56f9-d600-43ad-9557-2ad8b09ebe6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6801","nonce":3311949924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6803","nonce":3311949924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6807","nonce":3311949924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3311949924},{"type":"v1","addr":"172.21.15.153:6805","nonce":3311949924}]},"public_addr":"172.21.15.153:6801/3311949924","cluster_addr":"172.21.15.153:6803/3311949924","heartbeat_back_addr":"172.21.15.153:6807/3311949924","heartbeat_front_addr":"172.21.15.153:6805/3311949924","state":["exists","up"]},{"osd":5,"uuid":"4b325774-5b63-44d1-8f8d-b163a58a52d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6825","nonce":2972675875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6827","nonce":2972675875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6831","nonce":2972675875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2972675875},{"type":"v1","addr":"172.21.15.153:6829","nonce":2972675875}]},"public_addr":"172.21.15.153:6825/2972675875","cluster_addr":"172.21.15.153:6827/2972675875","heartbeat_back_addr":"172.21.15.153:6831/2972675875","heartbeat_front_addr":"172.21.15.153:6829/2972675875","state":["exists","up"]},{"osd":6,"uuid":"92e00df0-52f6-4871-9ecc-275d6acc9487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6809","nonce":3269269432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6811","nonce":3269269432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6815","nonce":3269269432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3269269432},{"type":"v1","addr":"172.21.15.153:6813","nonce":3269269432}]},"public_addr":"172.21.15.153:6809/3269269432","cluster_addr":"172.21.15.153:6811/3269269432","heartbeat_back_addr":"172.21.15.153:6815/3269269432","heartbeat_front_addr":"172.21.15.153:6813/3269269432","state":["exists","up"]},{"osd":7,"uuid":"f7e0deaf-2b1b-43ef-b4a0-4af1d568564f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6817","nonce":3440899718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6819","nonce":3440899718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6823","nonce":3440899718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3440899718},{"type":"v1","addr":"172.21.15.153:6821","nonce":3440899718}]},"public_addr":"172.21.15.153:6817/3440899718","cluster_addr":"172.21.15.153:6819/3440899718","heartbeat_back_addr":"172.21.15.153:6823/3440899718","heartbeat_front_addr":"172.21.15.153:6821/3440899718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.547134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.048140+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.051307+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:46.644554+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.454004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.767615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.423626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:45.902463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/3594830331":"2024-09-13T02:35:08.459275+0000","172.21.15.153:6833/3594830331":"2024-09-13T02:35:08.459275+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 msgr2=0x7f679406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).stop 2024-09-12T02:35:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 msgr2=0x7f67b00b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b3f0 tx=0x7f67ac00b8b0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 shutdown_connections 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0147360 0x7f67b0144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67b00d04a0 0x7f67b01385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 --2- 172.21.15.119:0/4136997657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67b00ae550 0x7f67b00b6af0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 >> 172.21.15.119:0/4136997657 conn(0x7f67b00b2f40 msgr2=0x7f67b00b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 shutdown_connections 2024-09-12T02:35:14.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:14.816+0000 7f67b756d640 1 -- 172.21.15.119:0/4136997657 wait complete. 2024-09-12T02:35:15.829 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:35:15.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:15.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.936+0000 7fd7a6b13640 1 Processor -- start 2024-09-12T02:35:15.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.936+0000 7fd7a6b13640 1 -- start start 2024-09-12T02:35:15.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a6b13640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 0x7fd7a00b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a6b13640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 0x7fd7a00ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a6b13640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a00ae690 con 0x7fd7a0067ae0 2024-09-12T02:35:15.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a6b13640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a00aec30 con 0x7fd7a015e2e0 2024-09-12T02:35:15.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a6b13640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a0067ff0 con 0x7fd7a00adce0 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd79ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd7a0067ae0 0x7fd7a015f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58128/0 (socket says 172.21.15.119:58128) 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd79ffff640 1 -- 172.21.15.119:0/3982808052 learned_addr learned my addr 172.21.15.119:0/3982808052 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a48af640 1 --2- 172.21.15.119:0/3982808052 >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 0x7fd7a00b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/3982808052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 0x7fd7a00ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd79f7fe640 1 -- 172.21.15.119:0/3982808052 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977916306 0 0) 0x7fd7a00ae690 con 0x7fd7a0067ae0 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd79f7fe640 1 -- 172.21.15.119:0/3982808052 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd790003520 con 0x7fd7a0067ae0 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a50b0640 1 -- 172.21.15.119:0/3982808052 >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 msgr2=0x7fd7a00b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.937+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/3982808052 >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 0x7fd7a00b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd7a50b0640 1 -- 172.21.15.119:0/3982808052 >> v1:172.21.15.119:6789/0 conn(0x7fd7a0067ae0 legacy=0x7fd7a015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd7a50b0640 1 -- 172.21.15.119:0/3982808052 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a00af390 con 0x7fd7a00adce0 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd7a48af640 1 --2- 172.21.15.119:0/3982808052 >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 0x7fd7a00b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/3982808052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 0x7fd7a00ae150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd798009d90 tx=0x7fd79802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab194d36e7d63398 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd79f7fe640 1 -- 172.21.15.119:0/3982808052 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798007740 con 0x7fd7a00adce0 2024-09-12T02:35:15.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd79f7fe640 1 -- 172.21.15.119:0/3982808052 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7980078e0 con 0x7fd7a00adce0 2024-09-12T02:35:15.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.938+0000 7fd79f7fe640 1 -- 172.21.15.119:0/3982808052 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798007c90 con 0x7fd7a00adce0 2024-09-12T02:35:15.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 -- 172.21.15.119:0/3982808052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 msgr2=0x7fd7a00ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/3982808052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 0x7fd7a00ae150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd798009d90 tx=0x7fd79802a660 comp rx=0 tx=0).stop 2024-09-12T02:35:15.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 -- 172.21.15.119:0/3982808052 shutdown_connections 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/3982808052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a00adce0 0x7fd7a00ae150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/3982808052 >> v2:172.21.15.153:3300/0 conn(0x7fd7a015e2e0 0x7fd7a00b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 -- 172.21.15.119:0/3982808052 >> 172.21.15.119:0/3982808052 conn(0x7fd7a0073590 msgr2=0x7fd7a006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 -- 172.21.15.119:0/3982808052 shutdown_connections 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.939+0000 7fd7a6b13640 1 -- 172.21.15.119:0/3982808052 wait complete. 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.940+0000 7fd7a6b13640 1 Processor -- start 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.940+0000 7fd7a6b13640 1 -- start start 2024-09-12T02:35:15.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a0067ae0 0x7fd7a015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 0x7fd7a00cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7a015e2e0 0x7fd7a00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00afc30 con 0x7fd7a00adce0 2024-09-12T02:35:15.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00af950 con 0x7fd7a015e2e0 2024-09-12T02:35:15.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a6b13640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a015e6c0 con 0x7fd7a0067ae0 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 0x7fd7a00cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 0x7fd7a00cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58696/0 (socket says 172.21.15.119:58696) 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 -- 172.21.15.119:0/2277995056 learned_addr learned my addr 172.21.15.119:0/2277995056 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a48af640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a0067ae0 0x7fd7a015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7a015e2e0 0x7fd7a00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 -- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a0067ae0 msgr2=0x7fd7a015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7a0067ae0 0x7fd7a015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 -- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7a015e2e0 msgr2=0x7fd7a00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7a015e2e0 0x7fd7a00cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.941+0000 7fd79ffff640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a015fc00 con 0x7fd7a00adce0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd79ffff640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 0x7fd7a00cf460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c460 tx=0x7fd78c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c017070 con 0x7fd7a00adce0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c005ce0 con 0x7fd7a00adce0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a015fee0 con 0x7fd7a00adce0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c007290 con 0x7fd7a00adce0 2024-09-12T02:35:15.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.942+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01604a0 con 0x7fd7a00adce0 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.943+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7a015f9b0 con 0x7fd7a00adce0 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.943+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd78c01a070 con 0x7fd7a00adce0 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd79d7fa640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd78406be30 0x7fd78406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fd78c08a4a0 con 0x7fd7a00adce0 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd7a48af640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd78406be30 0x7fd78406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd79d7fa640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7fd7840722d0 0x7fd784074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd784074de0 con 0x7fd7840722d0 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd78c08a930 con 0x7fd7a00adce0 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7fd7840722d0 0x7fd784074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd7a48af640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd78406be30 0x7fd78406e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd794009560 tx=0x7fd794009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.944+0000 7fd7a50b0640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7fd7840722d0 0x7fd784074710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.945+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== osd.0 v2:172.21.15.119:6808/323475018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd784074de0 con 0x7fd7840722d0 2024-09-12T02:35:15.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.957+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 --> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd7a015bd40 con 0x7fd7840722d0 2024-09-12T02:35:15.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.957+0000 7fd79d7fa640 1 -- 172.21.15.119:0/2277995056 <== osd.0 v2:172.21.15.119:6808/323475018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd798007640 con 0x7fd7840722d0 2024-09-12T02:35:15.959 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:15.959 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:15.959 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:15.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7fd7840722d0 msgr2=0x7fd784074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6808/323475018,v1:172.21.15.119:6809/323475018] conn(0x7fd7840722d0 0x7fd784074710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd78406be30 msgr2=0x7fd78406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fd78406be30 0x7fd78406e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd794009560 tx=0x7fd794009190 comp rx=0 tx=0).stop 2024-09-12T02:35:15.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 msgr2=0x7fd7a00cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 --2- 172.21.15.119:0/2277995056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7a00adce0 0x7fd7a00cf460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c460 tx=0x7fd78c00c920 comp rx=0 tx=0).stop 2024-09-12T02:35:15.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a50b0640 1 -- 172.21.15.119:0/2277995056 reap_dead start 2024-09-12T02:35:15.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 shutdown_connections 2024-09-12T02:35:15.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 >> 172.21.15.119:0/2277995056 conn(0x7fd7a0073590 msgr2=0x7fd7a006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 shutdown_connections 2024-09-12T02:35:15.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:15.958+0000 7fd7a6b13640 1 -- 172.21.15.119:0/2277995056 wait complete. 2024-09-12T02:35:15.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:35:16.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.068+0000 7f320102e640 1 Processor -- start 2024-09-12T02:35:16.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.068+0000 7f320102e640 1 -- start start 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f320102e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f320102e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f320102e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31fc0d3690 con 0x7f31fc0d30f0 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f320102e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f31fc06d530 con 0x7f31fc15e5f0 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f320102e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc0d3970 con 0x7f31fc0b6690 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fb59e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.119:54468/0 (socket says 172.21.15.119:54468) 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fb59e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.119:37848/0 (socket says 172.21.15.119:37848) 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31f259c640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f31fc0d30f0 0x7f31fc0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:57188/0 (socket says 172.21.15.119:57188) 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 -- 172.21.15.119:0/1123475987 learned_addr learned my addr 172.21.15.119:0/1123475987 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 -- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 msgr2=0x7f31fc06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 -- 172.21.15.119:0/1123475987 >> v1:172.21.15.153:6789/0 conn(0x7f31fc0d30f0 legacy=0x7f31fc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fad9d640 1 -- 172.21.15.119:0/1123475987 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc06cee0 con 0x7f31fc15e5f0 2024-09-12T02:35:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.069+0000 7f31fb59e640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.070+0000 7f31fad9d640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009870 tx=0x7f31ec02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67c3b08d2233f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.070+0000 7f31fa59c640 1 -- 172.21.15.119:0/1123475987 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec037070 con 0x7f31fc15e5f0 2024-09-12T02:35:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.070+0000 7f31fa59c640 1 -- 172.21.15.119:0/1123475987 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec032440 con 0x7f31fc15e5f0 2024-09-12T02:35:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.070+0000 7f31fa59c640 1 -- 172.21.15.119:0/1123475987 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec032810 con 0x7f31fc15e5f0 2024-09-12T02:35:16.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 -- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15e5f0 msgr2=0x7f31fc0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009870 tx=0x7f31ec02a270 comp rx=0 tx=0).stop 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 -- 172.21.15.119:0/1123475987 shutdown_connections 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc0b6690 0x7f31fc06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 --2- 172.21.15.119:0/1123475987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15e5f0 0x7f31fc0d4dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 -- 172.21.15.119:0/1123475987 >> 172.21.15.119:0/1123475987 conn(0x7f31fc08bfc0 msgr2=0x7f31fc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 -- 172.21.15.119:0/1123475987 shutdown_connections 2024-09-12T02:35:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.071+0000 7f320102e640 1 -- 172.21.15.119:0/1123475987 wait complete. 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.072+0000 7f320102e640 1 Processor -- start 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.072+0000 7f320102e640 1 -- start start 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0d30f0 0x7f31fc161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc15e5f0 0x7f31fc0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc0d5310 con 0x7f31fc0b6690 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc15e9d0 con 0x7f31fc0d30f0 2024-09-12T02:35:16.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f320102e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc06df00 con 0x7f31fc15e5f0 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58712/0 (socket says 172.21.15.119:58712) 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 -- 172.21.15.119:0/1721075277 learned_addr learned my addr 172.21.15.119:0/1721075277 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31f259c640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0d30f0 0x7f31fc161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fb59e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc15e5f0 0x7f31fc0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 -- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc15e5f0 msgr2=0x7f31fc0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc15e5f0 0x7f31fc0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 -- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0d30f0 msgr2=0x7f31fc161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0d30f0 0x7f31fc161620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 -- 172.21.15.119:0/1721075277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc0ca550 con 0x7f31fc0b6690 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.073+0000 7f31fad9d640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000c00 tx=0x7f31ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.074+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec037040 con 0x7f31fc0b6690 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.074+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec042070 con 0x7f31fc0b6690 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.074+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31fc0ca830 con 0x7f31fc0b6690 2024-09-12T02:35:16.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.074+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0308a0 con 0x7f31fc0b6690 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.074+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31fc15ebf0 con 0x7f31fc0b6690 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.075+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31fc06d9c0 con 0x7f31fc0b6690 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.075+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31ec030a40 con 0x7f31fc0b6690 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.075+0000 7f31f3fff640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 0x7f31dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.076+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f31ec0ab330 con 0x7f31fc0b6690 2024-09-12T02:35:16.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.076+0000 7f31f259c640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 0x7f31dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.076+0000 7f31f259c640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 0x7f31dc06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31fc155170 tx=0x7f31e4007e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.080+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31ec079ee0 con 0x7f31fc0b6690 2024-09-12T02:35:16.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.245+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f31fc0c7980 con 0x7f31dc06be30 2024-09-12T02:35:16.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.246+0000 7f31f3fff640 1 -- 172.21.15.119:0/1721075277 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31fc0c7980 con 0x7f31dc06be30 2024-09-12T02:35:16.247 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 msgr2=0x7f31dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 0x7f31dc06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31fc155170 tx=0x7f31e4007e20 comp rx=0 tx=0).stop 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 msgr2=0x7f31fc154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000c00 tx=0x7f31ec0046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 shutdown_connections 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f31dc06be30 0x7f31dc06e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31fc15e5f0 0x7f31fc0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0d30f0 0x7f31fc161620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 --2- 172.21.15.119:0/1721075277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31fc0b6690 0x7f31fc154c30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 >> 172.21.15.119:0/1721075277 conn(0x7f31fc08bfc0 msgr2=0x7f31fc15bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 shutdown_connections 2024-09-12T02:35:16.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.248+0000 7f320102e640 1 -- 172.21.15.119:0/1721075277 wait complete. 2024-09-12T02:35:16.260 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:35:16.260 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:16.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.363+0000 7fdea9c27640 1 Processor -- start 2024-09-12T02:35:16.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.363+0000 7fdea9c27640 1 -- start start 2024-09-12T02:35:16.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea9c27640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdea415e7f0 0x7fdea40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea9c27640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea4071180 0x7fdea406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea9c27640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea406cdc0 con 0x7fdea40af210 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea9c27640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdea406d0a0 con 0x7fdea415e7f0 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea9c27640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdea406d380 con 0x7fdea4071180 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdea415e7f0 0x7fdea40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fde9bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdea40af210 0x7fdea4070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58140/0 (socket says 172.21.15.119:58140) 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fde9bfff640 1 -- 172.21.15.119:0/269505302 learned_addr learned my addr 172.21.15.119:0/269505302 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:16.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea3fff640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea4071180 0x7fdea406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea2ffd640 1 -- 172.21.15.119:0/269505302 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653401940 0 0) 0x7fdea406cdc0 con 0x7fdea40af210 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea2ffd640 1 -- 172.21.15.119:0/269505302 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde90003520 con 0x7fdea40af210 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea37fe640 1 -- 172.21.15.119:0/269505302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea4071180 msgr2=0x7fdea406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea37fe640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea4071180 0x7fdea406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea37fe640 1 -- 172.21.15.119:0/269505302 >> v1:172.21.15.119:6789/0 conn(0x7fdea40af210 legacy=0x7fdea4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.364+0000 7fdea37fe640 1 -- 172.21.15.119:0/269505302 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea406d660 con 0x7fdea415e7f0 2024-09-12T02:35:16.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.365+0000 7fdea37fe640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea415e7f0 0x7fdea40b6d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde940097a0 tx=0x7fde9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c23d78719ce0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.365+0000 7fdea2ffd640 1 -- 172.21.15.119:0/269505302 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94037070 con 0x7fdea415e7f0 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.365+0000 7fdea2ffd640 1 -- 172.21.15.119:0/269505302 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94032440 con 0x7fdea415e7f0 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.365+0000 7fdea2ffd640 1 -- 172.21.15.119:0/269505302 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde940327f0 con 0x7fdea415e7f0 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 -- 172.21.15.119:0/269505302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea415e7f0 msgr2=0x7fdea40b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea415e7f0 0x7fdea40b6d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde940097a0 tx=0x7fde9402a180 comp rx=0 tx=0).stop 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 -- 172.21.15.119:0/269505302 shutdown_connections 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea4071180 0x7fdea406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 --2- 172.21.15.119:0/269505302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea415e7f0 0x7fdea40b6d10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 -- 172.21.15.119:0/269505302 >> 172.21.15.119:0/269505302 conn(0x7fdea40b3f30 msgr2=0x7fdea40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 -- 172.21.15.119:0/269505302 shutdown_connections 2024-09-12T02:35:16.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.366+0000 7fdea9c27640 1 -- 172.21.15.119:0/269505302 wait complete. 2024-09-12T02:35:16.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.367+0000 7fdea9c27640 1 Processor -- start 2024-09-12T02:35:16.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.367+0000 7fdea9c27640 1 -- start start 2024-09-12T02:35:16.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.367+0000 7fdea9c27640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea4071180 0x7fdea4151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 0x7fdea415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea415e7f0 0x7fdea4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdea40b73d0 con 0x7fdea40af210 2024-09-12T02:35:16.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdea40b7250 con 0x7fdea4071180 2024-09-12T02:35:16.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdea40b7550 con 0x7fdea415e7f0 2024-09-12T02:35:16.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 0x7fdea415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 0x7fdea415ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58732/0 (socket says 172.21.15.119:58732) 2024-09-12T02:35:16.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 -- 172.21.15.119:0/3329965848 learned_addr learned my addr 172.21.15.119:0/3329965848 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea37fe640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea4071180 0x7fdea4151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea3fff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea415e7f0 0x7fdea4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 -- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea415e7f0 msgr2=0x7fdea4155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea415e7f0 0x7fdea4155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 -- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea4071180 msgr2=0x7fdea4151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea4071180 0x7fdea4151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea415f640 con 0x7fdea40af210 2024-09-12T02:35:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fde9bfff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 0x7fdea415ec60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fde8c001eb0 tx=0x7fde8c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c017070 con 0x7fdea40af210 2024-09-12T02:35:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c005d00 con 0x7fdea40af210 2024-09-12T02:35:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea415f920 con 0x7fdea40af210 2024-09-12T02:35:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c007310 con 0x7fdea40af210 2024-09-12T02:35:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.368+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea4152550 con 0x7fdea40af210 2024-09-12T02:35:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.369+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdea4152250 con 0x7fdea40af210 2024-09-12T02:35:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde8c01a070 con 0x7fdea40af210 2024-09-12T02:35:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde8406be30 0x7fde8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fde8c089fa0 con 0x7fdea40af210 2024-09-12T02:35:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea37fe640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde8406be30 0x7fde8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde840722d0 0x7fde84074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde8c015e70 con 0x7fde840722d0 2024-09-12T02:35:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fde8c091050 con 0x7fdea40af210 2024-09-12T02:35:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.370+0000 7fdea3fff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde840722d0 0x7fde84074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.371+0000 7fdea37fe640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde8406be30 0x7fde8406e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde94034000 tx=0x7fde9402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.371+0000 7fdea3fff640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde840722d0 0x7fde84074710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.371+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== osd.1 v2:172.21.15.119:6816/1265598191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde8c015e70 con 0x7fde840722d0 2024-09-12T02:35:16.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 --> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdea40b6d10 con 0x7fde840722d0 2024-09-12T02:35:16.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea0ff9640 1 -- 172.21.15.119:0/3329965848 <== osd.1 v2:172.21.15.119:6816/1265598191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdea40b6d10 con 0x7fde840722d0 2024-09-12T02:35:16.385 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:16.386 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:16.386 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:16.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde840722d0 msgr2=0x7fde84074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6816/1265598191,v1:172.21.15.119:6817/1265598191] conn(0x7fde840722d0 0x7fde84074710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde8406be30 msgr2=0x7fde8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fde8406be30 0x7fde8406e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde94034000 tx=0x7fde9402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:16.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 msgr2=0x7fdea415ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 --2- 172.21.15.119:0/3329965848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea40af210 0x7fdea415ec60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fde8c001eb0 tx=0x7fde8c00c820 comp rx=0 tx=0).stop 2024-09-12T02:35:16.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea3fff640 1 -- 172.21.15.119:0/3329965848 reap_dead start 2024-09-12T02:35:16.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 shutdown_connections 2024-09-12T02:35:16.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 >> 172.21.15.119:0/3329965848 conn(0x7fdea40b3f30 msgr2=0x7fdea40af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 shutdown_connections 2024-09-12T02:35:16.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.384+0000 7fdea9c27640 1 -- 172.21.15.119:0/3329965848 wait complete. 2024-09-12T02:35:16.396 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:35:16.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.494+0000 7f9500250640 1 Processor -- start 2024-09-12T02:35:16.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 -- start start 2024-09-12T02:35:16.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80b69d0 0x7f94f8162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94f80b0180 0x7f94f8154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f815eb60 con 0x7f94f80af280 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f94f80b6db0 con 0x7f94f80b0180 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.495+0000 7f9500250640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94f815ee40 con 0x7f94f80b69d0 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fe7ed640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94f80b0180 0x7f94f8154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fd7eb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f94f80af280 0x7f94f80afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58144/0 (socket says 172.21.15.119:58144) 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fd7eb640 1 -- 172.21.15.119:0/1722318137 learned_addr learned my addr 172.21.15.119:0/1722318137 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fdfec640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80b69d0 0x7f94f8162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fe7ed640 1 -- 172.21.15.119:0/1722318137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80b69d0 msgr2=0x7f94f8162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fe7ed640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80b69d0 0x7f94f8162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fe7ed640 1 -- 172.21.15.119:0/1722318137 >> v1:172.21.15.119:6789/0 conn(0x7f94f80af280 legacy=0x7f94f80afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fe7ed640 1 -- 172.21.15.119:0/1722318137 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f815f120 con 0x7f94f80b0180 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.496+0000 7f94fcfea640 1 -- 172.21.15.119:0/1722318137 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965876318 0 0) 0x7f94f815eb60 con 0x7f94f80af280 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f94fe7ed640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b0180 0x7f94f8154d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009dc0 tx=0x7f94f002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4b17e486f245f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f94fcfea640 1 -- 172.21.15.119:0/1722318137 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0007740 con 0x7f94f80b0180 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f94fcfea640 1 -- 172.21.15.119:0/1722318137 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f00078e0 con 0x7f94f80b0180 2024-09-12T02:35:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f94fcfea640 1 -- 172.21.15.119:0/1722318137 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0007cb0 con 0x7f94f80b0180 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 -- 172.21.15.119:0/1722318137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b0180 msgr2=0x7f94f8154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b0180 0x7f94f8154d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009dc0 tx=0x7f94f002a560 comp rx=0 tx=0).stop 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 -- 172.21.15.119:0/1722318137 shutdown_connections 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b0180 0x7f94f8154d00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 --2- 172.21.15.119:0/1722318137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80b69d0 0x7f94f8162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 -- 172.21.15.119:0/1722318137 >> 172.21.15.119:0/1722318137 conn(0x7f94f806bc10 msgr2=0x7f94f806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 -- 172.21.15.119:0/1722318137 shutdown_connections 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.497+0000 7f9500250640 1 -- 172.21.15.119:0/1722318137 wait complete. 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 Processor -- start 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 -- start start 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80af280 0x7f94f814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f80b0180 0x7f94f8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8155240 con 0x7f94f80b69d0 2024-09-12T02:35:16.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94f80af6e0 con 0x7f94f80b0180 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f9500250640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94f81553c0 con 0x7f94f80af280 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f94fe7ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f94fe7ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58750/0 (socket says 172.21.15.119:58750) 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.499+0000 7f94fe7ed640 1 -- 172.21.15.119:0/685098253 learned_addr learned my addr 172.21.15.119:0/685098253 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fdfec640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80af280 0x7f94f814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fd7eb640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f80b0180 0x7f94f8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 -- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80af280 msgr2=0x7f94f814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80af280 0x7f94f814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 -- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f80b0180 msgr2=0x7f94f8150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f80b0180 0x7f94f8150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 -- 172.21.15.119:0/685098253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f80cf230 con 0x7f94f80b69d0 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94fe7ed640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94f002ab50 tx=0x7f94f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0040070 con 0x7f94f80b69d0 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0031bc0 con 0x7f94f80b69d0 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0009450 con 0x7f94f80b69d0 2024-09-12T02:35:16.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f80cf510 con 0x7f94f80b69d0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.500+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f80cfad0 con 0x7f94f80b69d0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.501+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f80affa0 con 0x7f94f80b69d0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.501+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94f0039040 con 0x7f94f80b69d0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.502+0000 7f94f67fc640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 0x7f94e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.502+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f94f00ac470 con 0x7f94f80b69d0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.502+0000 7f94fdfec640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 0x7f94e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.502+0000 7f94fdfec640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 0x7f94e406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009aa0 tx=0x7f94e8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.506+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94f80affa0 con 0x7f94f80b69d0 2024-09-12T02:35:16.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.671+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f94f81513c0 con 0x7f94e406be30 2024-09-12T02:35:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.671+0000 7f94f67fc640 1 -- 172.21.15.119:0/685098253 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94e8011a00 con 0x7f94e406be30 2024-09-12T02:35:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:35:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 msgr2=0x7f94e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 0x7f94e406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009aa0 tx=0x7f94e8009190 comp rx=0 tx=0).stop 2024-09-12T02:35:16.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 msgr2=0x7f94f80b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94f002ab50 tx=0x7f94f0004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:16.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 shutdown_connections 2024-09-12T02:35:16.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f94e406be30 0x7f94e406e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94f80b69d0 0x7f94f80b1a60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f80b0180 0x7f94f8150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 --2- 172.21.15.119:0/685098253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94f80af280 0x7f94f814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 >> 172.21.15.119:0/685098253 conn(0x7f94f806bc10 msgr2=0x7f94f8153420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 shutdown_connections 2024-09-12T02:35:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.673+0000 7f9500250640 1 -- 172.21.15.119:0/685098253 wait complete. 2024-09-12T02:35:16.685 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:35:16.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:16.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.788+0000 7f3d9243c640 1 Processor -- start 2024-09-12T02:35:16.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.788+0000 7f3d9243c640 1 -- start start 2024-09-12T02:35:16.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d9243c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d9243c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c0b4620 con 0x7f3d8c072050 2024-09-12T02:35:16.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d9243c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c0ce100 con 0x7f3d8c15e900 2024-09-12T02:35:16.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d9243c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c0b4f60 con 0x7f3d8c0b4020 2024-09-12T02:35:16.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d909d9640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3d8c072050 0x7f3d8c0cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58146/0 (socket says 172.21.15.119:58146) 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d909d9640 1 -- 172.21.15.119:0/4093645325 learned_addr learned my addr 172.21.15.119:0/4093645325 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8b7fe640 1 --2- 172.21.15.119:0/4093645325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509156813 0 0) 0x7f3d8c0b4620 con 0x7f3d8c072050 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d74003520 con 0x7f3d8c072050 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243587443 0 0) 0x7f3d8c0ce100 con 0x7f3d8c15e900 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d8c0b4620 con 0x7f3d8c15e900 2024-09-12T02:35:16.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4143471901 0 0) 0x7f3d74003520 con 0x7f3d8c072050 2024-09-12T02:35:16.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8b7fe640 1 -- 172.21.15.119:0/4093645325 >> v1:172.21.15.153:6789/0 conn(0x7f3d8c15e900 legacy=0x7f3d8c0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8b7fe640 1 -- 172.21.15.119:0/4093645325 >> v1:172.21.15.119:6789/0 conn(0x7f3d8c072050 legacy=0x7f3d8c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.789+0000 7f3d8b7fe640 1 -- 172.21.15.119:0/4093645325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c0ce3a0 con 0x7f3d8c0b4020 2024-09-12T02:35:16.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.790+0000 7f3d8b7fe640 1 --2- 172.21.15.119:0/4093645325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c0b4a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097d0 tx=0x7f3d8002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6349cf357896519 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.790+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80037070 con 0x7f3d8c0b4020 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8002ab90 con 0x7f3d8c0b4020 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d8affd640 1 -- 172.21.15.119:0/4093645325 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840019f0 con 0x7f3d8c0b4020 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 -- 172.21.15.119:0/4093645325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 msgr2=0x7f3d8c0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 --2- 172.21.15.119:0/4093645325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c0b4a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097d0 tx=0x7f3d8002a100 comp rx=0 tx=0).stop 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 -- 172.21.15.119:0/4093645325 shutdown_connections 2024-09-12T02:35:16.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 --2- 172.21.15.119:0/4093645325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c0b4a20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 -- 172.21.15.119:0/4093645325 >> 172.21.15.119:0/4093645325 conn(0x7f3d8c06bdf0 msgr2=0x7f3d8c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 -- 172.21.15.119:0/4093645325 shutdown_connections 2024-09-12T02:35:16.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.791+0000 7f3d9243c640 1 -- 172.21.15.119:0/4093645325 wait complete. 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.792+0000 7f3d9243c640 1 Processor -- start 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.792+0000 7f3d9243c640 1 -- start start 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c072050 0x7f3d8c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c09dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 0x7f3d8c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c0cf590 con 0x7f3d8c15e900 2024-09-12T02:35:16.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c0ce960 con 0x7f3d8c072050 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d9243c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c0cf710 con 0x7f3d8c0b4020 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d909d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 0x7f3d8c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d909d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 0x7f3d8c143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58758/0 (socket says 172.21.15.119:58758) 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d909d9640 1 -- 172.21.15.119:0/1559921858 learned_addr learned my addr 172.21.15.119:0/1559921858 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d8bfff640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c072050 0x7f3d8c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.793+0000 7f3d8b7fe640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c09dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 -- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 msgr2=0x7f3d8c09dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b4020 0x7f3d8c09dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 -- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c072050 msgr2=0x7f3d8c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c072050 0x7f3d8c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c145fc0 con 0x7f3d8c15e900 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d909d9640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 0x7f3d8c143f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001350 tx=0x7f3d8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d8c15e900 2024-09-12T02:35:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84012400 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c1f6770 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012830 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.794+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1f6d30 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.795+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d8c0af160 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.795+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d8401a070 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d88ff9640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f3d7806be30 0x7f3d7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f3d8408ab40 con 0x7f3d8c15e900 2024-09-12T02:35:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d8bfff640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f3d7806be30 0x7f3d7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d88ff9640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f3d780722d0 0x7f3d78074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d8400de50 con 0x7f3d780722d0 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3d8408f260 con 0x7f3d8c15e900 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d8b7fe640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f3d780722d0 0x7f3d78074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.796+0000 7f3d8bfff640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f3d7806be30 0x7f3d7806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0011e0 tx=0x7f3d7c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.797+0000 7f3d8b7fe640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f3d780722d0 0x7f3d78074710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.797+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== osd.2 v2:172.21.15.119:6800/2688916930 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d8400de50 con 0x7f3d780722d0 2024-09-12T02:35:16.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.809+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 --> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d8c0b4a20 con 0x7f3d780722d0 2024-09-12T02:35:16.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d88ff9640 1 -- 172.21.15.119:0/1559921858 <== osd.2 v2:172.21.15.119:6800/2688916930 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d8c0b4a20 con 0x7f3d780722d0 2024-09-12T02:35:16.811 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:16.811 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:16.811 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:16.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f3d780722d0 msgr2=0x7f3d78074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6800/2688916930,v1:172.21.15.119:6801/2688916930] conn(0x7f3d780722d0 0x7f3d78074710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f3d7806be30 msgr2=0x7f3d7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f3d7806be30 0x7f3d7806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0011e0 tx=0x7f3d7c009040 comp rx=0 tx=0).stop 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 msgr2=0x7f3d8c143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 --2- 172.21.15.119:0/1559921858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c15e900 0x7f3d8c143f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001350 tx=0x7f3d8400cf90 comp rx=0 tx=0).stop 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d909d9640 1 -- 172.21.15.119:0/1559921858 reap_dead start 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 shutdown_connections 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 >> 172.21.15.119:0/1559921858 conn(0x7f3d8c06bdf0 msgr2=0x7f3d8c06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 shutdown_connections 2024-09-12T02:35:16.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.810+0000 7f3d9243c640 1 -- 172.21.15.119:0/1559921858 wait complete. 2024-09-12T02:35:16.822 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:35:16.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.922+0000 7feb16bd6640 1 Processor -- start 2024-09-12T02:35:16.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.922+0000 7feb16bd6640 1 -- start start 2024-09-12T02:35:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb16bd6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feb100d30f0 0x7feb100b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb16bd6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 0x7feb1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb16bd6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb100d3690 con 0x7feb1015e5f0 2024-09-12T02:35:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb16bd6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7feb1006d530 con 0x7feb100d30f0 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb16bd6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7feb100d3970 con 0x7feb100b64c0 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb0ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feb100d30f0 0x7feb100b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb0ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feb100d30f0 0x7feb100b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58766/0 (socket says 172.21.15.119:58766) 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb0ffff640 1 -- 172.21.15.119:0/3943405338 learned_addr learned my addr 172.21.15.119:0/3943405338 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.923+0000 7feb15173640 1 --2- 172.21.15.119:0/3943405338 >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 0x7feb1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0ffff640 1 -- 172.21.15.119:0/3943405338 >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 msgr2=0x7feb1006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0ffff640 1 --2- 172.21.15.119:0/3943405338 >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 0x7feb1006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0ffff640 1 -- 172.21.15.119:0/3943405338 >> v1:172.21.15.153:6789/0 conn(0x7feb1015e5f0 legacy=0x7feb100d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0ffff640 1 -- 172.21.15.119:0/3943405338 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1006cee0 con 0x7feb100d30f0 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb15173640 1 --2- 172.21.15.119:0/3943405338 >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 0x7feb1006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0ffff640 1 --2- 172.21.15.119:0/3943405338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb100b5f80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb100ba580 tx=0x7feb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debe61ffcf49e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0f7fe640 1 -- 172.21.15.119:0/3943405338 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04037070 con 0x7feb100d30f0 2024-09-12T02:35:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0f7fe640 1 -- 172.21.15.119:0/3943405338 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb04032440 con 0x7feb100d30f0 2024-09-12T02:35:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.924+0000 7feb0f7fe640 1 -- 172.21.15.119:0/3943405338 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04032810 con 0x7feb100d30f0 2024-09-12T02:35:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 -- 172.21.15.119:0/3943405338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 msgr2=0x7feb100b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 --2- 172.21.15.119:0/3943405338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb100b5f80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb100ba580 tx=0x7feb0402a270 comp rx=0 tx=0).stop 2024-09-12T02:35:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 -- 172.21.15.119:0/3943405338 shutdown_connections 2024-09-12T02:35:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 --2- 172.21.15.119:0/3943405338 >> v2:172.21.15.153:3300/0 conn(0x7feb100b64c0 0x7feb1006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 --2- 172.21.15.119:0/3943405338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb100b5f80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 -- 172.21.15.119:0/3943405338 >> 172.21.15.119:0/3943405338 conn(0x7feb1008bfc0 msgr2=0x7feb100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 -- 172.21.15.119:0/3943405338 shutdown_connections 2024-09-12T02:35:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.925+0000 7feb16bd6640 1 -- 172.21.15.119:0/3943405338 wait complete. 2024-09-12T02:35:16.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.926+0000 7feb16bd6640 1 Processor -- start 2024-09-12T02:35:16.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.926+0000 7feb16bd6640 1 -- start start 2024-09-12T02:35:16.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb100b64c0 0x7feb100b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb1015e5f0 0x7feb101e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb1006df00 con 0x7feb100d30f0 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb1015e9d0 con 0x7feb100b64c0 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb16bd6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feb1006e080 con 0x7feb1015e5f0 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb0ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb0ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58774/0 (socket says 172.21.15.119:58774) 2024-09-12T02:35:16.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb0ffff640 1 -- 172.21.15.119:0/2281103946 learned_addr learned my addr 172.21.15.119:0/2281103946 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb14972640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb100b64c0 0x7feb100b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb15173640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb1015e5f0 0x7feb101e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.927+0000 7feb0ffff640 1 -- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb1015e5f0 msgr2=0x7feb101e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0ffff640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb1015e5f0 0x7feb101e8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0ffff640 1 -- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb100b64c0 msgr2=0x7feb100b9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0ffff640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb100b64c0 0x7feb100b9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0ffff640 1 -- 172.21.15.119:0/2281103946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10160ec0 con 0x7feb100d30f0 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0ffff640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb0402a2b0 tx=0x7feb040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04041020 con 0x7feb100d30f0 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb040306c0 con 0x7feb100d30f0 2024-09-12T02:35:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb100b9360 con 0x7feb100d30f0 2024-09-12T02:35:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04037040 con 0x7feb100d30f0 2024-09-12T02:35:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.928+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb100ba100 con 0x7feb100d30f0 2024-09-12T02:35:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.929+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb100cb380 con 0x7feb100d30f0 2024-09-12T02:35:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.929+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb04044020 con 0x7feb100d30f0 2024-09-12T02:35:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.930+0000 7feb0d7fa640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 0x7feafc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.930+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7feb040ab3a0 con 0x7feb100d30f0 2024-09-12T02:35:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.930+0000 7feb14972640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 0x7feafc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.930+0000 7feb14972640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 0x7feafc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb100b9850 tx=0x7feb00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:16.934+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb0404b030 con 0x7feb100d30f0 2024-09-12T02:35:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.100+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7feb1006d9c0 con 0x7feafc06be30 2024-09-12T02:35:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.100+0000 7feb0d7fa640 1 -- 172.21.15.119:0/2281103946 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feb1006d9c0 con 0x7feafc06be30 2024-09-12T02:35:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:35:17.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.102+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 msgr2=0x7feafc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.102+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 0x7feafc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb100b9850 tx=0x7feb00009040 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.102+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 msgr2=0x7feb1015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.102+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb0402a2b0 tx=0x7feb040046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 shutdown_connections 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7feafc06be30 0x7feafc06e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb1015e5f0 0x7feb101e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb100d30f0 0x7feb1015c5d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 --2- 172.21.15.119:0/2281103946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb100b64c0 0x7feb100b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 >> 172.21.15.119:0/2281103946 conn(0x7feb1008bfc0 msgr2=0x7feb100d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 shutdown_connections 2024-09-12T02:35:17.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.103+0000 7feb16bd6640 1 -- 172.21.15.119:0/2281103946 wait complete. 2024-09-12T02:35:17.114 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:35:17.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.217+0000 7fb097ad0640 1 Processor -- start 2024-09-12T02:35:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.217+0000 7fb097ad0640 1 -- start start 2024-09-12T02:35:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb097ad0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 0x7fb09006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb097ad0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb09015ff70 con 0x7fb090162e30 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb097ad0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0900d4d10 con 0x7fb0900cf280 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb097ad0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb09006de90 con 0x7fb090162340 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb09606d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb090162e30 0x7fb0900d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58158/0 (socket says 172.21.15.119:58158) 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.218+0000 7fb09606d640 1 -- 172.21.15.119:0/3803158640 learned_addr learned my addr 172.21.15.119:0/3803158640 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09586c640 1 --2- 172.21.15.119:0/3803158640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 0x7fb09006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433946009 0 0) 0x7fb09015ff70 con 0x7fb090162e30 2024-09-12T02:35:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb078003520 con 0x7fb090162e30 2024-09-12T02:35:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 853629856 0 0) 0x7fb0900d4d10 con 0x7fb0900cf280 2024-09-12T02:35:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb09015ff70 con 0x7fb0900cf280 2024-09-12T02:35:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323477564 0 0) 0x7fb078003520 con 0x7fb090162e30 2024-09-12T02:35:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09586c640 1 -- 172.21.15.119:0/3803158640 >> v1:172.21.15.153:6789/0 conn(0x7fb0900cf280 legacy=0x7fb090162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09586c640 1 -- 172.21.15.119:0/3803158640 >> v1:172.21.15.119:6789/0 conn(0x7fb090162e30 legacy=0x7fb0900d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.219+0000 7fb09586c640 1 -- 172.21.15.119:0/3803158640 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0900d4ff0 con 0x7fb090162340 2024-09-12T02:35:17.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb09586c640 1 --2- 172.21.15.119:0/3803158640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 0x7fb09006d740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb080009dc0 tx=0x7fb08002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdecc4bf0f22b475 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088001670 con 0x7fb090162340 2024-09-12T02:35:17.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb080007540 con 0x7fb090162340 2024-09-12T02:35:17.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb09486a640 1 -- 172.21.15.119:0/3803158640 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080007910 con 0x7fb090162340 2024-09-12T02:35:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb097ad0640 1 -- 172.21.15.119:0/3803158640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 msgr2=0x7fb09006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb097ad0640 1 --2- 172.21.15.119:0/3803158640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 0x7fb09006d740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb080009dc0 tx=0x7fb08002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb097ad0640 1 -- 172.21.15.119:0/3803158640 shutdown_connections 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb097ad0640 1 --2- 172.21.15.119:0/3803158640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162340 0x7fb09006d740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.220+0000 7fb097ad0640 1 -- 172.21.15.119:0/3803158640 >> 172.21.15.119:0/3803158640 conn(0x7fb09008bfc0 msgr2=0x7fb0900d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.221+0000 7fb097ad0640 1 -- 172.21.15.119:0/3803158640 shutdown_connections 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.221+0000 7fb097ad0640 1 -- 172.21.15.119:0/3803158640 wait complete. 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 Processor -- start 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 -- start start 2024-09-12T02:35:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 0x7fb0900c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb090162340 0x7fb090155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162e30 0x7fb0900b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0900cf6c0 con 0x7fb0900cf280 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0900d52d0 con 0x7fb090162340 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb097ad0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0900d30a0 con 0x7fb090162e30 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.222+0000 7fb09586c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 0x7fb0900c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 0x7fb0900c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58782/0 (socket says 172.21.15.119:58782) 2024-09-12T02:35:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 -- 172.21.15.119:0/3166939021 learned_addr learned my addr 172.21.15.119:0/3166939021 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09606d640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162e30 0x7fb0900b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09506b640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb090162340 0x7fb090155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 -- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162e30 msgr2=0x7fb0900b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb090162e30 0x7fb0900b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 -- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb090162340 msgr2=0x7fb090155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb090162340 0x7fb090155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0900b9b90 con 0x7fb0900cf280 2024-09-12T02:35:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb09586c640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 0x7fb0900c8e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb080000f80 tx=0x7fb080004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080040070 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb080031c40 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080007e70 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0900b9e00 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.223+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0900cd240 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.224+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0900d34b0 con 0x7fb0900cf280 2024-09-12T02:35:17.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb080039040 con 0x7fb0900cf280 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07c06be30 0x7fb07c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb0800ac3d0 con 0x7fb0900cf280 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb09506b640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07c06be30 0x7fb07c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7fb07c0722d0 0x7fb07c074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb08003ee50 con 0x7fb07c0722d0 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb0800b3050 con 0x7fb0900cf280 2024-09-12T02:35:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.225+0000 7fb09606d640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7fb07c0722d0 0x7fb07c074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.226+0000 7fb09506b640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07c06be30 0x7fb07c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb09015d1c0 tx=0x7fb084009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.226+0000 7fb09606d640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7fb07c0722d0 0x7fb07c074710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.226+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== osd.3 v2:172.21.15.119:6824/2158673929 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb08003ee50 con 0x7fb07c0722d0 2024-09-12T02:35:17.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 --> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb09008e640 con 0x7fb07c0722d0 2024-09-12T02:35:17.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb08e7fc640 1 -- 172.21.15.119:0/3166939021 <== osd.3 v2:172.21.15.119:6824/2158673929 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb09008e640 con 0x7fb07c0722d0 2024-09-12T02:35:17.240 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:17.240 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:17.240 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7fb07c0722d0 msgr2=0x7fb07c074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6824/2158673929,v1:172.21.15.119:6825/2158673929] conn(0x7fb07c0722d0 0x7fb07c074710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07c06be30 msgr2=0x7fb07c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb07c06be30 0x7fb07c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb09015d1c0 tx=0x7fb084009040 comp rx=0 tx=0).stop 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 msgr2=0x7fb0900c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 --2- 172.21.15.119:0/3166939021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0900cf280 0x7fb0900c8e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb080000f80 tx=0x7fb080004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb09606d640 1 -- 172.21.15.119:0/3166939021 reap_dead start 2024-09-12T02:35:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 shutdown_connections 2024-09-12T02:35:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 >> 172.21.15.119:0/3166939021 conn(0x7fb09008bfc0 msgr2=0x7fb0900d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 shutdown_connections 2024-09-12T02:35:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.239+0000 7fb097ad0640 1 -- 172.21.15.119:0/3166939021 wait complete. 2024-09-12T02:35:17.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:35:17.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.349+0000 7f2a838e6640 1 Processor -- start 2024-09-12T02:35:17.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.349+0000 7f2a838e6640 1 -- start start 2024-09-12T02:35:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a838e6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a7c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a838e6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a7c162060 0x7f2a7c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a838e6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7c06e870 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a838e6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c06d9f0 con 0x7f2a7c162060 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a838e6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c06dcd0 con 0x7f2a7c161c80 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a81e83640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2a7c0b64b0 0x7f2a7c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58168/0 (socket says 172.21.15.119:58168) 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a81e83640 1 -- 172.21.15.119:0/4248193368 learned_addr learned my addr 172.21.15.119:0/4248193368 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a80e81640 1 --2- 172.21.15.119:0/4248193368 >> v2:172.21.15.153:3300/0 conn(0x7f2a7c162060 0x7f2a7c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398413825 0 0) 0x7f2a74001490 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a68003520 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a81682640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a7c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714485533 0 0) 0x7f2a68003520 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 msgr2=0x7f2a7c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a7c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 >> v2:172.21.15.153:3300/0 conn(0x7f2a7c162060 msgr2=0x7f2a7c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 --2- 172.21.15.119:0/4248193368 >> v2:172.21.15.153:3300/0 conn(0x7f2a7c162060 0x7f2a7c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c06dfb0 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f2a74001bc0 con 0x7f2a7c0b64b0 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 >> v1:172.21.15.119:6789/0 conn(0x7f2a7c0b64b0 legacy=0x7f2a7c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a680039b0 0x7f2a68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06d9f0 con 0x7f2a680039b0 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06dcd0 con 0x7f2a68004800 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6800b9c0 con 0x7f2a7c161c80 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a81682640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a680039b0 0x7f2a68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.350+0000 7f2a80e81640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81e83640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 -- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 msgr2=0x7f2a680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c161c80 0x7f2a680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 -- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a68004800 msgr2=0x7f2a68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 -- 172.21.15.119:0/4248193368 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a68003520 con 0x7f2a680039b0 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a81682640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a680039b0 0x7f2a68003dd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009ac0 tx=0x7f2a68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51269ee4b87a3563 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78036070 con 0x7f2a680039b0 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a78031400 con 0x7f2a680039b0 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.351+0000 7f2a6ffff640 1 -- 172.21.15.119:0/4248193368 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78009690 con 0x7f2a680039b0 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 -- 172.21.15.119:0/4248193368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a680039b0 msgr2=0x7f2a68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 --2- 172.21.15.119:0/4248193368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a680039b0 0x7f2a68003dd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009ac0 tx=0x7f2a68005830 comp rx=0 tx=0).stop 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a81e83640 1 -- 172.21.15.119:0/4248193368 reap_dead start 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 -- 172.21.15.119:0/4248193368 shutdown_connections 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 -- 172.21.15.119:0/4248193368 >> 172.21.15.119:0/4248193368 conn(0x7f2a7c0d44f0 msgr2=0x7f2a7c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 -- 172.21.15.119:0/4248193368 shutdown_connections 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.352+0000 7f2a838e6640 1 -- 172.21.15.119:0/4248193368 wait complete. 2024-09-12T02:35:17.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.353+0000 7f2a838e6640 1 Processor -- start 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.353+0000 7f2a838e6640 1 -- start start 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a680039b0 0x7f2a7c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c159e30 0x7f2a7c0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c0d2a10 con 0x7f2a7c1562a0 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c0d2890 con 0x7f2a680039b0 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a838e6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c06e330 con 0x7f2a7c159e30 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58814/0 (socket says 172.21.15.119:58814) 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 -- 172.21.15.119:0/3868947683 learned_addr learned my addr 172.21.15.119:0/3868947683 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81682640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a680039b0 0x7f2a7c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 -- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c159e30 msgr2=0x7f2a7c0b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c159e30 0x7f2a7c0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 -- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a680039b0 msgr2=0x7f2a7c158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a680039b0 0x7f2a7c158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.354+0000 7f2a81e83640 1 -- 172.21.15.119:0/3868947683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0b8d00 con 0x7f2a7c1562a0 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a81e83640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c06ed60 tx=0x7f2a74004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a740078a0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a74018070 con 0x7f2a7c1562a0 2024-09-12T02:35:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a740133f0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c0b8fe0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.355+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c0b95a0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.356+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c0d07c0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.356+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a74013590 con 0x7f2a7c1562a0 2024-09-12T02:35:17.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.357+0000 7f2a6dffb640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 0x7f2a6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.357+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f2a7408b2d0 con 0x7f2a7c1562a0 2024-09-12T02:35:17.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.357+0000 7f2a81682640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 0x7f2a6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.357+0000 7f2a81682640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 0x7f2a6006e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a78033000 tx=0x7f2a78008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.361+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a7c06e870 con 0x7f2a7c1562a0 2024-09-12T02:35:17.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.525+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2a7c06d5f0 con 0x7f2a6006be60 2024-09-12T02:35:17.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.525+0000 7f2a6dffb640 1 -- 172.21.15.119:0/3868947683 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2a7c06d5f0 con 0x7f2a6006be60 2024-09-12T02:35:17.527 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:35:17.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 msgr2=0x7f2a6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 0x7f2a6006e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a78033000 tx=0x7f2a78008030 comp rx=0 tx=0).stop 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 msgr2=0x7f2a7c0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c06ed60 tx=0x7f2a74004f80 comp rx=0 tx=0).stop 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 shutdown_connections 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f2a6006be60 0x7f2a6006e320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a7c1562a0 0x7f2a7c0d0d80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a7c159e30 0x7f2a7c0b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 --2- 172.21.15.119:0/3868947683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a680039b0 0x7f2a7c158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 >> 172.21.15.119:0/3868947683 conn(0x7f2a7c0d44f0 msgr2=0x7f2a7c162e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 shutdown_connections 2024-09-12T02:35:17.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.527+0000 7f2a838e6640 1 -- 172.21.15.119:0/3868947683 wait complete. 2024-09-12T02:35:17.539 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:35:17.539 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:17.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.641+0000 7fb72a2a6640 1 Processor -- start 2024-09-12T02:35:17.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.641+0000 7fb72a2a6640 1 -- start start 2024-09-12T02:35:17.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb72a2a6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb72415b410 0x7fb724072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb72a2a6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7240ce6e0 0x7fb724072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb72a2a6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7240cec90 con 0x7fb72415b7f0 2024-09-12T02:35:17.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb72a2a6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb7240cef70 con 0x7fb72415b410 2024-09-12T02:35:17.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb72a2a6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240cf250 con 0x7fb7240ce6e0 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb723fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb72415b410 0x7fb724072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb723fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb72415b410 0x7fb724072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58824/0 (socket says 172.21.15.119:58824) 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb723fff640 1 -- 172.21.15.119:0/698760652 learned_addr learned my addr 172.21.15.119:0/698760652 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.642+0000 7fb728843640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7240ce6e0 0x7fb724072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb723fff640 1 -- 172.21.15.119:0/698760652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7240ce6e0 msgr2=0x7fb724072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb723fff640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7240ce6e0 0x7fb724072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb723fff640 1 -- 172.21.15.119:0/698760652 >> v1:172.21.15.153:6789/0 conn(0x7fb72415b7f0 legacy=0x7fb7240cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb723fff640 1 -- 172.21.15.119:0/698760652 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7240cf530 con 0x7fb72415b410 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb723fff640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b410 0x7fb724072050 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab4c590795ea59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb722ffd640 1 -- 172.21.15.119:0/698760652 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714037070 con 0x7fb72415b410 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb722ffd640 1 -- 172.21.15.119:0/698760652 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714032440 con 0x7fb72415b410 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.643+0000 7fb722ffd640 1 -- 172.21.15.119:0/698760652 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714032810 con 0x7fb72415b410 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 -- 172.21.15.119:0/698760652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b410 msgr2=0x7fb724072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b410 0x7fb724072050 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 -- 172.21.15.119:0/698760652 shutdown_connections 2024-09-12T02:35:17.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7240ce6e0 0x7fb724072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/698760652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b410 0x7fb724072050 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 -- 172.21.15.119:0/698760652 >> 172.21.15.119:0/698760652 conn(0x7fb72406bdf0 msgr2=0x7fb72406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 -- 172.21.15.119:0/698760652 shutdown_connections 2024-09-12T02:35:17.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.644+0000 7fb72a2a6640 1 -- 172.21.15.119:0/698760652 wait complete. 2024-09-12T02:35:17.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.645+0000 7fb72a2a6640 1 Processor -- start 2024-09-12T02:35:17.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.645+0000 7fb72a2a6640 1 -- start start 2024-09-12T02:35:17.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7240ce6e0 0x7fb72414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb72415b410 0x7fb7240afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 0x7fb7241f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7240b33e0 con 0x7fb72415b7f0 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7240b3260 con 0x7fb7240ce6e0 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb72a2a6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240b3560 con 0x7fb72415b410 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb728843640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 0x7fb7241f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb728843640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 0x7fb7241f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58838/0 (socket says 172.21.15.119:58838) 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb728843640 1 -- 172.21.15.119:0/172788350 learned_addr learned my addr 172.21.15.119:0/172788350 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb723fff640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7240ce6e0 0x7fb72414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.646+0000 7fb7237fe640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb72415b410 0x7fb7240afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 -- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb72415b410 msgr2=0x7fb7240afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb72415b410 0x7fb7240afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 -- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7240ce6e0 msgr2=0x7fb72414f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7240ce6e0 0x7fb72414f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7241f2360 con 0x7fb72415b7f0 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb728843640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 0x7fb7241f1870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb71c007ed0 tx=0x7fb71c0106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c018070 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c0138a0 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7241f2640 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c013c90 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.647+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72414f710 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.648+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb72414faf0 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.648+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb71c01b070 con 0x7fb72415b7f0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb720ff9640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb71006be30 0x7fb71006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb723fff640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb71006be30 0x7fb71006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb71c08db70 con 0x7fb72415b7f0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb720ff9640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fb7100722d0 0x7fb710074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb710074de0 con 0x7fb7100722d0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb71c0922c0 con 0x7fb72415b7f0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb7237fe640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fb7100722d0 0x7fb710074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.649+0000 7fb723fff640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb71006be30 0x7fb71006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb714034000 tx=0x7fb71402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.650+0000 7fb7237fe640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fb7100722d0 0x7fb710074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.650+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== osd.4 v2:172.21.15.153:6800/3311949924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb710074de0 con 0x7fb7100722d0 2024-09-12T02:35:17.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 --> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb7240cdfd0 con 0x7fb7100722d0 2024-09-12T02:35:17.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb720ff9640 1 -- 172.21.15.119:0/172788350 <== osd.4 v2:172.21.15.153:6800/3311949924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb7240cdfd0 con 0x7fb7100722d0 2024-09-12T02:35:17.664 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:17.665 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fb7100722d0 msgr2=0x7fb710074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.153:6800/3311949924,v1:172.21.15.153:6801/3311949924] conn(0x7fb7100722d0 0x7fb710074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb71006be30 msgr2=0x7fb71006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fb71006be30 0x7fb71006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb714034000 tx=0x7fb71402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 msgr2=0x7fb7241f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 --2- 172.21.15.119:0/172788350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb72415b7f0 0x7fb7241f1870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb71c007ed0 tx=0x7fb71c0106c0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb728843640 1 -- 172.21.15.119:0/172788350 reap_dead start 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.663+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 shutdown_connections 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.664+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 >> 172.21.15.119:0/172788350 conn(0x7fb72406bdf0 msgr2=0x7fb7240731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.664+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 shutdown_connections 2024-09-12T02:35:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.664+0000 7fb72a2a6640 1 -- 172.21.15.119:0/172788350 wait complete. 2024-09-12T02:35:17.675 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:35:17.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.773+0000 7f860f71a640 1 Processor -- start 2024-09-12T02:35:17.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.773+0000 7f860f71a640 1 -- start start 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860f71a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86080d04a0 0x7f86080d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860f71a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 0x7f86080ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860f71a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860806cb30 con 0x7f8608147360 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860f71a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f86080d0e50 con 0x7f86080d04a0 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860f71a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f860806bfb0 con 0x7f86080ae550 2024-09-12T02:35:17.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86080d04a0 0x7f86080d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86080d04a0 0x7f86080d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58840/0 (socket says 172.21.15.119:58840) 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 -- 172.21.15.119:0/574769167 learned_addr learned my addr 172.21.15.119:0/574769167 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860d4b6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8608147360 0x7f8608070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58172/0 (socket says 172.21.15.119:58172) 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860dcb7640 1 --2- 172.21.15.119:0/574769167 >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 0x7f86080ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 -- 172.21.15.119:0/574769167 >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 msgr2=0x7f86080ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 --2- 172.21.15.119:0/574769167 >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 0x7f86080ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 -- 172.21.15.119:0/574769167 >> v1:172.21.15.119:6789/0 conn(0x7f8608147360 legacy=0x7f8608070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860ccb5640 1 -- 172.21.15.119:0/574769167 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860806c290 con 0x7f86080d04a0 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f85fffff640 1 -- 172.21.15.119:0/574769167 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488479631 0 0) 0x7f860806cb30 con 0x7f8608147360 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.774+0000 7f860dcb7640 1 --2- 172.21.15.119:0/574769167 >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 0x7f86080ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.775+0000 7f860ccb5640 1 --2- 172.21.15.119:0/574769167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080d0910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86080ced30 tx=0x7f85f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fb1b75d9a3aa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.775+0000 7f85fffff640 1 -- 172.21.15.119:0/574769167 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8037070 con 0x7f86080d04a0 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.775+0000 7f85fffff640 1 -- 172.21.15.119:0/574769167 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f8032440 con 0x7f86080d04a0 2024-09-12T02:35:17.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.775+0000 7f85fffff640 1 -- 172.21.15.119:0/574769167 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8032810 con 0x7f86080d04a0 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 -- 172.21.15.119:0/574769167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 msgr2=0x7f86080d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 --2- 172.21.15.119:0/574769167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080d0910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86080ced30 tx=0x7f85f802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 -- 172.21.15.119:0/574769167 shutdown_connections 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 --2- 172.21.15.119:0/574769167 >> v2:172.21.15.153:3300/0 conn(0x7f86080ae550 0x7f86080ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 --2- 172.21.15.119:0/574769167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080d0910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 -- 172.21.15.119:0/574769167 >> 172.21.15.119:0/574769167 conn(0x7f86080b2f40 msgr2=0x7f86080b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 -- 172.21.15.119:0/574769167 shutdown_connections 2024-09-12T02:35:17.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.776+0000 7f860f71a640 1 -- 172.21.15.119:0/574769167 wait complete. 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.777+0000 7f860f71a640 1 Processor -- start 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.777+0000 7f860f71a640 1 -- start start 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86080ae550 0x7f860813e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8608147360 0x7f8608142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8608070fa0 con 0x7f86080d04a0 2024-09-12T02:35:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f860806c850 con 0x7f86080ae550 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f860806bc10 con 0x7f8608147360 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58846/0 (socket says 172.21.15.119:58846) 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 -- 172.21.15.119:0/982213070 learned_addr learned my addr 172.21.15.119:0/982213070 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860d4b6640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86080ae550 0x7f860813e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 -- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8608147360 msgr2=0x7f8608142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8608147360 0x7f8608142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 -- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86080ae550 msgr2=0x7f860813e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86080ae550 0x7f860813e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 -- 172.21.15.119:0/982213070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081f4370 con 0x7f86080d04a0 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860ccb5640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f85f802a220 tx=0x7f85f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8037040 con 0x7f86080d04a0 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f8042070 con 0x7f86080d04a0 2024-09-12T02:35:17.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081f4650 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8030bb0 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.778+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081f4c10 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.779+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86080d0910 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.780+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85f8047460 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.780+0000 7f85fdffb640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 0x7f85ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.780+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f85f80ab8e0 con 0x7f86080d04a0 2024-09-12T02:35:17.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.780+0000 7f860d4b6640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 0x7f85ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.781+0000 7f860d4b6640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 0x7f85ec06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86040012e0 tx=0x7f8604009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.785+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85f8045360 con 0x7f86080d04a0 2024-09-12T02:35:17.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.951+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f860806f650 con 0x7f85ec06be30 2024-09-12T02:35:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.951+0000 7f85fdffb640 1 -- 172.21.15.119:0/982213070 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f860806f650 con 0x7f85ec06be30 2024-09-12T02:35:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:35:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 msgr2=0x7f85ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 0x7f85ec06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86040012e0 tx=0x7f8604009040 comp rx=0 tx=0).stop 2024-09-12T02:35:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 msgr2=0x7f86080b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f85f802a220 tx=0x7f85f80046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 shutdown_connections 2024-09-12T02:35:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f85ec06be30 0x7f85ec06e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8608147360 0x7f8608142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d04a0 0x7f86080b6c40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 --2- 172.21.15.119:0/982213070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86080ae550 0x7f860813e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 >> 172.21.15.119:0/982213070 conn(0x7f86080b2f40 msgr2=0x7f86080b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 shutdown_connections 2024-09-12T02:35:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:17.953+0000 7f860f71a640 1 -- 172.21.15.119:0/982213070 wait complete. 2024-09-12T02:35:17.965 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:35:17.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:18.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.067+0000 7fcd46b49640 1 Processor -- start 2024-09-12T02:35:18.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 -- start start 2024-09-12T02:35:18.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd4015b570 0x7fcd40071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd4015b950 0x7fcd400cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd400ccf50 0x7fcd400cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fcd400740e0 con 0x7fcd4015b570 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcd40073b20 con 0x7fcd4015b950 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd46b49640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd40073e00 con 0x7fcd400ccf50 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.068+0000 7fcd448e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd4015b570 0x7fcd40071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd4015b570 0x7fcd40071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39106/0 (socket says 172.21.15.119:39106) 2024-09-12T02:35:18.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 -- 172.21.15.119:0/2449025508 learned_addr learned my addr 172.21.15.119:0/2449025508 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd3ffff640 1 --2- 172.21.15.119:0/2449025508 >> v2:172.21.15.153:3300/0 conn(0x7fcd4015b950 0x7fcd400cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd450e6640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd400ccf50 0x7fcd400cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 -- 172.21.15.119:0/2449025508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd400ccf50 msgr2=0x7fcd400cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd400ccf50 0x7fcd400cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 -- 172.21.15.119:0/2449025508 >> v2:172.21.15.153:3300/0 conn(0x7fcd4015b950 msgr2=0x7fcd400cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 --2- 172.21.15.119:0/2449025508 >> v2:172.21.15.153:3300/0 conn(0x7fcd4015b950 0x7fcd400cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 -- 172.21.15.119:0/2449025508 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd400cf320 con 0x7fcd4015b570 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.069+0000 7fcd448e5640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd4015b570 0x7fcd40071e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd40073710 tx=0x7fcd3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bfb488d0cd51f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd3f7fe640 1 -- 172.21.15.119:0/2449025508 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd4015b570 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd3f7fe640 1 -- 172.21.15.119:0/2449025508 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd4015b570 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd3f7fe640 1 -- 172.21.15.119:0/2449025508 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032810 con 0x7fcd4015b570 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 -- 172.21.15.119:0/2449025508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd4015b570 msgr2=0x7fcd40071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd4015b570 0x7fcd40071e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd40073710 tx=0x7fcd3402a140 comp rx=0 tx=0).stop 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 -- 172.21.15.119:0/2449025508 shutdown_connections 2024-09-12T02:35:18.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd400ccf50 0x7fcd400cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 --2- 172.21.15.119:0/2449025508 >> v2:172.21.15.153:3300/0 conn(0x7fcd4015b950 0x7fcd400cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 --2- 172.21.15.119:0/2449025508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd4015b570 0x7fcd40071e40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 -- 172.21.15.119:0/2449025508 >> 172.21.15.119:0/2449025508 conn(0x7fcd4006bdf0 msgr2=0x7fcd4006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 -- 172.21.15.119:0/2449025508 shutdown_connections 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.070+0000 7fcd46b49640 1 -- 172.21.15.119:0/2449025508 wait complete. 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.071+0000 7fcd46b49640 1 Processor -- start 2024-09-12T02:35:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.071+0000 7fcd46b49640 1 -- start start 2024-09-12T02:35:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 0x7fcd4014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd4015b570 0x7fcd400c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd4015b950 0x7fcd400b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd400cf840 con 0x7fcd400ccf50 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd40072450 con 0x7fcd4015b570 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd46b49640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd400cf9c0 con 0x7fcd4015b950 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd448e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 0x7fcd4014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd448e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 0x7fcd4014d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39108/0 (socket says 172.21.15.119:39108) 2024-09-12T02:35:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.072+0000 7fcd448e5640 1 -- 172.21.15.119:0/1507780684 learned_addr learned my addr 172.21.15.119:0/1507780684 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd450e6640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd4015b950 0x7fcd400b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd3ffff640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd4015b570 0x7fcd400c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 -- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd4015b950 msgr2=0x7fcd400b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd4015b950 0x7fcd400b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 -- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd4015b570 msgr2=0x7fcd400c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd4015b570 0x7fcd400c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd400c6e60 con 0x7fcd400ccf50 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd3ffff640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd4015b570 0x7fcd400c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd448e5640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 0x7fcd4014d540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a180 tx=0x7fcd340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34041020 con 0x7fcd400ccf50 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3403d620 con 0x7fcd400ccf50 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd400c7140 con 0x7fcd400ccf50 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037040 con 0x7fcd400ccf50 2024-09-12T02:35:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.073+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd400c7700 con 0x7fcd400ccf50 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.074+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd40071e40 con 0x7fcd400ccf50 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd34044020 con 0x7fcd400ccf50 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcd2406be30 0x7fcd2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fcd340ab3f0 con 0x7fcd400ccf50 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3ffff640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcd2406be30 0x7fcd2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fcd240722d0 0x7fcd24074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd34032440 con 0x7fcd240722d0 2024-09-12T02:35:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcd340b2050 con 0x7fcd400ccf50 2024-09-12T02:35:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd450e6640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fcd240722d0 0x7fcd24074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.075+0000 7fcd3ffff640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcd2406be30 0x7fcd2406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd401f78a0 tx=0x7fcd2c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.076+0000 7fcd450e6640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fcd240722d0 0x7fcd24074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.077+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== osd.5 v2:172.21.15.153:6824/2972675875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd34032440 con 0x7fcd240722d0 2024-09-12T02:35:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.089+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 --> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcd40151d60 con 0x7fcd240722d0 2024-09-12T02:35:18.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd3d7fa640 1 -- 172.21.15.119:0/1507780684 <== osd.5 v2:172.21.15.153:6824/2972675875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcd40151d60 con 0x7fcd240722d0 2024-09-12T02:35:18.090 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:18.091 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:18.091 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fcd240722d0 msgr2=0x7fcd24074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.153:6824/2972675875,v1:172.21.15.153:6825/2972675875] conn(0x7fcd240722d0 0x7fcd24074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcd2406be30 msgr2=0x7fcd2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fcd2406be30 0x7fcd2406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd401f78a0 tx=0x7fcd2c008040 comp rx=0 tx=0).stop 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 msgr2=0x7fcd4014d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 --2- 172.21.15.119:0/1507780684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd400ccf50 0x7fcd4014d540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a180 tx=0x7fcd340046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd450e6640 1 -- 172.21.15.119:0/1507780684 reap_dead start 2024-09-12T02:35:18.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 shutdown_connections 2024-09-12T02:35:18.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 >> 172.21.15.119:0/1507780684 conn(0x7fcd4006bdf0 msgr2=0x7fcd4015d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 shutdown_connections 2024-09-12T02:35:18.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.090+0000 7fcd46b49640 1 -- 172.21.15.119:0/1507780684 wait complete. 2024-09-12T02:35:18.101 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:35:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.201+0000 7f01756ba640 1 Processor -- start 2024-09-12T02:35:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.201+0000 7f01756ba640 1 -- start start 2024-09-12T02:35:18.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f01756ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f017006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f01756ba640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01700cfcc0 0x7f01700d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f01756ba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700d2700 con 0x7f01700d4fd0 2024-09-12T02:35:18.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f01756ba640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f01700cedb0 con 0x7f01700cfcc0 2024-09-12T02:35:18.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f01756ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f01700cf090 con 0x7f017015e760 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016e7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f01700d4fd0 0x7f01700cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34464/0 (socket says 172.21.15.119:34464) 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016e7fc640 1 -- 172.21.15.119:0/98614371 learned_addr learned my addr 172.21.15.119:0/98614371 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3798167735 0 0) 0x7f0158001290 con 0x7f01700d4fd0 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f015c003520 con 0x7f01700d4fd0 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016effd640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f017006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.202+0000 7f016f7fe640 1 --2- 172.21.15.119:0/98614371 >> v2:172.21.15.153:3300/0 conn(0x7f01700cfcc0 0x7f01700d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2586984940 0 0) 0x7f015c003520 con 0x7f01700d4fd0 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 msgr2=0x7f017006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f017006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 >> v2:172.21.15.153:3300/0 conn(0x7f01700cfcc0 msgr2=0x7f01700d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 --2- 172.21.15.119:0/98614371 >> v2:172.21.15.153:3300/0 conn(0x7f01700cfcc0 0x7f01700d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700b3c80 con 0x7f01700d4fd0 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f01580019e0 con 0x7f01700d4fd0 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 >> v1:172.21.15.119:6789/0 conn(0x7f01700d4fd0 legacy=0x7f01700cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f015c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 0x7f015c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f015c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cedb0 con 0x7f015c0039b0 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cf090 con 0x7f015c004800 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f015c00b9c0 con 0x7f017015e760 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f015c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016e7fc640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 0x7f015c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016f7fe640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f015c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 -- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 msgr2=0x7f015c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f015c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 -- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 msgr2=0x7f015c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 0x7f015c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016effd640 1 -- 172.21.15.119:0/98614371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c003520 con 0x7f015c0039b0 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.203+0000 7f016f7fe640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f017015e760 0x7f015c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f016effd640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f015c003dd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f016800e170 tx=0x7f015c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6486c8e007f7756 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168034020 con 0x7f015c0039b0 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01680305f0 con 0x7f015c0039b0 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f016dffb640 1 -- 172.21.15.119:0/98614371 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168009c10 con 0x7f015c0039b0 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f01756ba640 1 -- 172.21.15.119:0/98614371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 msgr2=0x7f015c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f01756ba640 1 --2- 172.21.15.119:0/98614371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f015c003dd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f016800e170 tx=0x7f015c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.204+0000 7f016f7fe640 1 -- 172.21.15.119:0/98614371 reap_dead start 2024-09-12T02:35:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.205+0000 7f01756ba640 1 -- 172.21.15.119:0/98614371 shutdown_connections 2024-09-12T02:35:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.205+0000 7f01756ba640 1 -- 172.21.15.119:0/98614371 >> 172.21.15.119:0/98614371 conn(0x7f017008bfc0 msgr2=0x7f01700d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.205+0000 7f01756ba640 1 -- 172.21.15.119:0/98614371 shutdown_connections 2024-09-12T02:35:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.205+0000 7f01756ba640 1 -- 172.21.15.119:0/98614371 wait complete. 2024-09-12T02:35:18.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.206+0000 7f01756ba640 1 Processor -- start 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.206+0000 7f01756ba640 1 -- start start 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170160690 0x7f0170156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0170156dd0 0x7f01700c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f017006cdd0 con 0x7f015c0039b0 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01700b3860 con 0x7f0170160690 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f017006cf50 con 0x7f0170156dd0 2024-09-12T02:35:18.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39128/0 (socket says 172.21.15.119:39128) 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 -- 172.21.15.119:0/1754301342 learned_addr learned my addr 172.21.15.119:0/1754301342 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016e7fc640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170160690 0x7f0170156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016f7fe640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0170156dd0 0x7f01700c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 -- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0170156dd0 msgr2=0x7f01700c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0170156dd0 0x7f01700c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 -- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170160690 msgr2=0x7f0170156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170160690 0x7f0170156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 -- 172.21.15.119:0/1754301342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700cce70 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f016effd640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0168033040 tx=0x7f0168009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168040070 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0168039a00 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01700cd150 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.207+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168034040 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.208+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0170160b10 con 0x7f015c0039b0 2024-09-12T02:35:18.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.208+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01701571b0 con 0x7f015c0039b0 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.209+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0168037020 con 0x7f015c0039b0 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.209+0000 7f01677fe640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 0x7f015006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.209+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f01680ab6c0 con 0x7f015c0039b0 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.209+0000 7f016e7fc640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 0x7f015006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.210+0000 7f016e7fc640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 0x7f015006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0158001470 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.214+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0168079c20 con 0x7f015c0039b0 2024-09-12T02:35:18.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.380+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f01700b6d20 con 0x7f015006be30 2024-09-12T02:35:18.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.381+0000 7f01677fe640 1 -- 172.21.15.119:0/1754301342 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f01700b6d20 con 0x7f015006be30 2024-09-12T02:35:18.382 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:35:18.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 msgr2=0x7f015006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 0x7f015006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0158001470 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-09-12T02:35:18.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 msgr2=0x7f01701545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0168033040 tx=0x7f0168009750 comp rx=0 tx=0).stop 2024-09-12T02:35:18.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 shutdown_connections 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f015006be30 0x7f015006e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0170156dd0 0x7f01700c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170160690 0x7f0170156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 --2- 172.21.15.119:0/1754301342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f015c0039b0 0x7f01701545a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 >> 172.21.15.119:0/1754301342 conn(0x7f017008bfc0 msgr2=0x7f01700b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 shutdown_connections 2024-09-12T02:35:18.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.383+0000 7f01756ba640 1 -- 172.21.15.119:0/1754301342 wait complete. 2024-09-12T02:35:18.394 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:35:18.395 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:18.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.497+0000 7f236ebcf640 1 Processor -- start 2024-09-12T02:35:18.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.497+0000 7f236ebcf640 1 -- start start 2024-09-12T02:35:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236ebcf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f236815e410 0x7f23680b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236ebcf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23680ae240 con 0x7f23680b40c0 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236ebcf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23680ae520 con 0x7f236806bc10 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236ebcf640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f23680ae800 con 0x7f236815e410 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f235ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f23680b40c0 0x7f23680aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34470/0 (socket says 172.21.15.119:34470) 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f235ffff640 1 -- 172.21.15.119:0/2184946988 learned_addr learned my addr 172.21.15.119:0/2184946988 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236c96b640 1 --2- 172.21.15.119:0/2184946988 >> v2:172.21.15.153:3300/0 conn(0x7f236815e410 0x7f23680b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f235f7fe640 1 -- 172.21.15.119:0/2184946988 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788683483 0 0) 0x7f23680ae240 con 0x7f23680b40c0 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f235f7fe640 1 -- 172.21.15.119:0/2184946988 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2350003520 con 0x7f23680b40c0 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236c96b640 1 -- 172.21.15.119:0/2184946988 >> v1:172.21.15.153:6789/0 conn(0x7f236806bc10 legacy=0x7f23680aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236c96b640 1 -- 172.21.15.119:0/2184946988 >> v1:172.21.15.119:6789/0 conn(0x7f23680b40c0 legacy=0x7f23680aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.498+0000 7f236c96b640 1 -- 172.21.15.119:0/2184946988 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23680aeae0 con 0x7f236815e410 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.499+0000 7f236c96b640 1 --2- 172.21.15.119:0/2184946988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f236815e410 0x7f23680b5fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23640097a0 tx=0x7f236402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71471d7422a29bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.499+0000 7f235f7fe640 1 -- 172.21.15.119:0/2184946988 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364037070 con 0x7f236815e410 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.499+0000 7f235f7fe640 1 -- 172.21.15.119:0/2184946988 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2364032440 con 0x7f236815e410 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.499+0000 7f235f7fe640 1 -- 172.21.15.119:0/2184946988 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23640327f0 con 0x7f236815e410 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 -- 172.21.15.119:0/2184946988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f236815e410 msgr2=0x7f23680b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 --2- 172.21.15.119:0/2184946988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f236815e410 0x7f23680b5fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23640097a0 tx=0x7f236402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 -- 172.21.15.119:0/2184946988 shutdown_connections 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 --2- 172.21.15.119:0/2184946988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f236815e410 0x7f23680b5fe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 -- 172.21.15.119:0/2184946988 >> 172.21.15.119:0/2184946988 conn(0x7f236809aa30 msgr2=0x7f23680b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 -- 172.21.15.119:0/2184946988 shutdown_connections 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.500+0000 7f236ebcf640 1 -- 172.21.15.119:0/2184946988 wait complete. 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.501+0000 7f236ebcf640 1 Processor -- start 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.501+0000 7f236ebcf640 1 -- start start 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f236806bc10 0x7f23680ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23680b40c0 0x7f236815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 0x7f2368156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f236815e970 con 0x7f236815e410 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f236815e7f0 con 0x7f23680b40c0 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236ebcf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23680af6f0 con 0x7f236806bc10 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 0x7f2368156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 0x7f2368156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39144/0 (socket says 172.21.15.119:39144) 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 -- 172.21.15.119:0/4207842578 learned_addr learned my addr 172.21.15.119:0/4207842578 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236c96b640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f236806bc10 0x7f23680ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f235ffff640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23680b40c0 0x7f236815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 -- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f236806bc10 msgr2=0x7f23680ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f236806bc10 0x7f23680ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 -- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23680b40c0 msgr2=0x7f236815bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23680b40c0 0x7f236815bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f236d16c640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236815d2b0 con 0x7f236815e410 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.502+0000 7f235ffff640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23680b40c0 0x7f236815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f236d16c640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 0x7f2368156b30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f236000c7a0 tx=0x7f236000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360003b70 con 0x7f236815e410 2024-09-12T02:35:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2360003d30 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236815c210 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236000aa90 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.503+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236815c7d0 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.504+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f236815ce90 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.504+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f236000ac30 con 0x7f236815e410 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235d7fa640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f235406be30 0x7f235406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f236008ad00 con 0x7f236815e410 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f236c96b640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f235406be30 0x7f235406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235d7fa640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f23540722d0 0x7f2354074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2360014e50 con 0x7f23540722d0 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f236008d320 con 0x7f236815e410 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235ffff640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f23540722d0 0x7f2354074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f236c96b640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f235406be30 0x7f235406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2364034000 tx=0x7f236402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.505+0000 7f235ffff640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f23540722d0 0x7f2354074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.506+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== osd.6 v2:172.21.15.153:6808/3269269432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2360014e50 con 0x7f23540722d0 2024-09-12T02:35:18.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.519+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 --> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23680afab0 con 0x7f23540722d0 2024-09-12T02:35:18.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.519+0000 7f235d7fa640 1 -- 172.21.15.119:0/4207842578 <== osd.6 v2:172.21.15.153:6808/3269269432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23680afab0 con 0x7f23540722d0 2024-09-12T02:35:18.520 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:18.520 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:18.520 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:18.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.519+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f23540722d0 msgr2=0x7f2354074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.519+0000 7f236ebcf640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.153:6808/3269269432,v1:172.21.15.153:6809/3269269432] conn(0x7f23540722d0 0x7f2354074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f235406be30 msgr2=0x7f235406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f235406be30 0x7f235406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2364034000 tx=0x7f236402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 msgr2=0x7f2368156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 --2- 172.21.15.119:0/4207842578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236815e410 0x7f2368156b30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f236000c7a0 tx=0x7f236000cc60 comp rx=0 tx=0).stop 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236d16c640 1 -- 172.21.15.119:0/4207842578 reap_dead start 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 shutdown_connections 2024-09-12T02:35:18.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 >> 172.21.15.119:0/4207842578 conn(0x7f236809aa30 msgr2=0x7f23680afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 shutdown_connections 2024-09-12T02:35:18.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.520+0000 7f236ebcf640 1 -- 172.21.15.119:0/4207842578 wait complete. 2024-09-12T02:35:18.531 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:35:18.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.629+0000 7f6a2f952640 1 Processor -- start 2024-09-12T02:35:18.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 -- start start 2024-09-12T02:35:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 0x7f6a280b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 0x7f6a280ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a280b6520 con 0x7f6a2815e990 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6a280b2c30 con 0x7f6a280ae140 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.630+0000 7f6a2f952640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6a280aeb30 con 0x7f6a2815e5b0 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2d6ee640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 0x7f6a280b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2deef640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 0x7f6a280ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2ceed640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6a2815e990 0x7f6a280b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:35486/0 (socket says 172.21.15.119:35486) 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2ceed640 1 -- 172.21.15.119:0/2489929077 learned_addr learned my addr 172.21.15.119:0/2489929077 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2d6ee640 1 -- 172.21.15.119:0/2489929077 >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 msgr2=0x7f6a280ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2d6ee640 1 --2- 172.21.15.119:0/2489929077 >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 0x7f6a280ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2d6ee640 1 -- 172.21.15.119:0/2489929077 >> v1:172.21.15.153:6789/0 conn(0x7f6a2815e990 legacy=0x7f6a280b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2d6ee640 1 -- 172.21.15.119:0/2489929077 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a280b1a40 con 0x7f6a2815e5b0 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.631+0000 7f6a2deef640 1 --2- 172.21.15.119:0/2489929077 >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 0x7f6a280ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.632+0000 7f6a2d6ee640 1 --2- 172.21.15.119:0/2489929077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 0x7f6a280b5f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a240097a0 tx=0x7f6a2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95a74733dc043bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.632+0000 7f6a1ffff640 1 -- 172.21.15.119:0/2489929077 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24037070 con 0x7f6a2815e5b0 2024-09-12T02:35:18.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.632+0000 7f6a1ffff640 1 -- 172.21.15.119:0/2489929077 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24032440 con 0x7f6a2815e5b0 2024-09-12T02:35:18.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.632+0000 7f6a1ffff640 1 -- 172.21.15.119:0/2489929077 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24032810 con 0x7f6a2815e5b0 2024-09-12T02:35:18.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 -- 172.21.15.119:0/2489929077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 msgr2=0x7f6a280b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2489929077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 0x7f6a280b5f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a240097a0 tx=0x7f6a2402a180 comp rx=0 tx=0).stop 2024-09-12T02:35:18.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 -- 172.21.15.119:0/2489929077 shutdown_connections 2024-09-12T02:35:18.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2489929077 >> v2:172.21.15.153:3300/0 conn(0x7f6a280ae140 0x7f6a280ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2489929077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a2815e5b0 0x7f6a280b5f40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 -- 172.21.15.119:0/2489929077 >> 172.21.15.119:0/2489929077 conn(0x7f6a28073490 msgr2=0x7f6a280b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 -- 172.21.15.119:0/2489929077 shutdown_connections 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.633+0000 7f6a2f952640 1 -- 172.21.15.119:0/2489929077 wait complete. 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.634+0000 7f6a2f952640 1 Processor -- start 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.634+0000 7f6a2f952640 1 -- start start 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a280ae140 0x7f6a280cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a2815e5b0 0x7f6a28151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6a280b0490 con 0x7f6a2815e990 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a280b2000 con 0x7f6a2815e5b0 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6a280b07e0 con 0x7f6a280ae140 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39152/0 (socket says 172.21.15.119:39152) 2024-09-12T02:35:18.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 -- 172.21.15.119:0/2096269858 learned_addr learned my addr 172.21.15.119:0/2096269858 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2d6ee640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a280ae140 0x7f6a280cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2ceed640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a2815e5b0 0x7f6a28151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 -- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a280ae140 msgr2=0x7f6a280cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a280ae140 0x7f6a280cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 -- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a2815e5b0 msgr2=0x7f6a28151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a2815e5b0 0x7f6a28151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 -- 172.21.15.119:0/2096269858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a281f4f00 con 0x7f6a2815e990 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2deef640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000efc0 tx=0x7f6a20009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20018030 con 0x7f6a2815e990 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2000cd80 con 0x7f6a2815e990 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a281f8210 con 0x7f6a2815e990 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.635+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20003bb0 con 0x7f6a2815e990 2024-09-12T02:35:18.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.636+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a281f5170 con 0x7f6a2815e990 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.636+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a281f5930 con 0x7f6a2815e990 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.637+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a20005d10 con 0x7f6a2815e990 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.637+0000 7f6a1dffb640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 0x7f6a0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.637+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f6a2008b5f0 con 0x7f6a2815e990 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.637+0000 7f6a2d6ee640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 0x7f6a0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.638+0000 7f6a2d6ee640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 0x7f6a0c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a24034000 tx=0x7f6a2402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.641+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a281f5930 con 0x7f6a2815e990 2024-09-12T02:35:18.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.810+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f6a280ae5f0 con 0x7f6a0c06be30 2024-09-12T02:35:18.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.811+0000 7f6a1dffb640 1 -- 172.21.15.119:0/2096269858 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a280ae5f0 con 0x7f6a0c06be30 2024-09-12T02:35:18.811 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:35:18.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 msgr2=0x7f6a0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 0x7f6a0c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a24034000 tx=0x7f6a2402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 msgr2=0x7f6a281f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000efc0 tx=0x7f6a20009f90 comp rx=0 tx=0).stop 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 shutdown_connections 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f6a0c06be30 0x7f6a0c06e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a2815e990 0x7f6a281f7650 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a2815e5b0 0x7f6a28151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 --2- 172.21.15.119:0/2096269858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a280ae140 0x7f6a280cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 >> 172.21.15.119:0/2096269858 conn(0x7f6a28073490 msgr2=0x7f6a28070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 shutdown_connections 2024-09-12T02:35:18.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.813+0000 7f6a2f952640 1 -- 172.21.15.119:0/2096269858 wait complete. 2024-09-12T02:35:18.824 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:35:18.825 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:35:18.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.930+0000 7fbcfb02e640 1 Processor -- start 2024-09-12T02:35:18.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.930+0000 7fbcfb02e640 1 -- start start 2024-09-12T02:35:18.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcfb02e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbcf415e7f0 0x7fbcf40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcfb02e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbcf40af210 0x7fbcf4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcfb02e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf406cdc0 con 0x7fbcf40b7250 2024-09-12T02:35:18.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcfb02e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf406d0a0 con 0x7fbcf415e7f0 2024-09-12T02:35:18.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcfb02e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf406d380 con 0x7fbcf40af210 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbcf415e7f0 0x7fbcf40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbcf415e7f0 0x7fbcf40b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39162/0 (socket says 172.21.15.119:39162) 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 -- 172.21.15.119:0/2806296826 learned_addr learned my addr 172.21.15.119:0/2806296826 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf3fff640 1 --2- 172.21.15.119:0/2806296826 >> v2:172.21.15.153:3300/0 conn(0x7fbcf40af210 0x7fbcf4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 -- 172.21.15.119:0/2806296826 >> v2:172.21.15.153:3300/0 conn(0x7fbcf40af210 msgr2=0x7fbcf4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 --2- 172.21.15.119:0/2806296826 >> v2:172.21.15.153:3300/0 conn(0x7fbcf40af210 0x7fbcf4070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 -- 172.21.15.119:0/2806296826 >> v1:172.21.15.153:6789/0 conn(0x7fbcf40b7250 legacy=0x7fbcf409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.931+0000 7fbcf8dca640 1 -- 172.21.15.119:0/2806296826 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf406d660 con 0x7fbcf415e7f0 2024-09-12T02:35:18.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.932+0000 7fbcf8dca640 1 --2- 172.21.15.119:0/2806296826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf40b6d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40b5ab0 tx=0x7fbce402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff65d51c6f8107d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.932+0000 7fbcf37fe640 1 -- 172.21.15.119:0/2806296826 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4037070 con 0x7fbcf415e7f0 2024-09-12T02:35:18.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.932+0000 7fbcf37fe640 1 -- 172.21.15.119:0/2806296826 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce4032440 con 0x7fbcf415e7f0 2024-09-12T02:35:18.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.932+0000 7fbcf37fe640 1 -- 172.21.15.119:0/2806296826 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4032810 con 0x7fbcf415e7f0 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 -- 172.21.15.119:0/2806296826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 msgr2=0x7fbcf40b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/2806296826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf40b6d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40b5ab0 tx=0x7fbce402a230 comp rx=0 tx=0).stop 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 -- 172.21.15.119:0/2806296826 shutdown_connections 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/2806296826 >> v2:172.21.15.153:3300/0 conn(0x7fbcf40af210 0x7fbcf4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/2806296826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf40b6d10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 -- 172.21.15.119:0/2806296826 >> 172.21.15.119:0/2806296826 conn(0x7fbcf40b3f30 msgr2=0x7fbcf40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 -- 172.21.15.119:0/2806296826 shutdown_connections 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.933+0000 7fbcfb02e640 1 -- 172.21.15.119:0/2806296826 wait complete. 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.934+0000 7fbcfb02e640 1 Processor -- start 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.934+0000 7fbcfb02e640 1 -- start start 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf40af210 0x7fbcf40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcf40b7250 0x7fbcf414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4071130 con 0x7fbcf415e7f0 2024-09-12T02:35:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4070fb0 con 0x7fbcf40af210 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcfb02e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf40712b0 con 0x7fbcf40b7250 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf414fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39164/0 (socket says 172.21.15.119:39164) 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 -- 172.21.15.119:0/253001784 learned_addr learned my addr 172.21.15.119:0/253001784 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf8dca640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf40af210 0x7fbcf40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf3fff640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcf40b7250 0x7fbcf414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 -- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcf40b7250 msgr2=0x7fbcf414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcf40b7250 0x7fbcf414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 -- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf40af210 msgr2=0x7fbcf40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf40af210 0x7fbcf40b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.935+0000 7fbcf95cb640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40cb750 con 0x7fbcf415e7f0 2024-09-12T02:35:18.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcf95cb640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf414fe90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00b9e0 tx=0x7fbcec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec003b70 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec003d10 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf40cba30 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00cb60 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.936+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf40cbff0 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.937+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcf40cc3f0 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.937+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcec00cd00 con 0x7fbcf415e7f0 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf17fa640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbce006be30 0x7fbce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fbcec08b620 con 0x7fbcf415e7f0 2024-09-12T02:35:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf8dca640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbce006be30 0x7fbce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf17fa640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fbce00722d0 0x7fbce0074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbce0074de0 con 0x7fbce00722d0 2024-09-12T02:35:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbcec08bab0 con 0x7fbcf415e7f0 2024-09-12T02:35:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf8dca640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbce006be30 0x7fbce006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbce4034000 tx=0x7fbce402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.938+0000 7fbcf3fff640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fbce00722d0 0x7fbce0074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.939+0000 7fbcf3fff640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fbce00722d0 0x7fbce0074710 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.940+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== osd.7 v2:172.21.15.153:6816/3440899718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbce0074de0 con 0x7fbce00722d0 2024-09-12T02:35:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.952+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 --> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcf4070a70 con 0x7fbce00722d0 2024-09-12T02:35:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.952+0000 7fbcf17fa640 1 -- 172.21.15.119:0/253001784 <== osd.7 v2:172.21.15.153:6816/3440899718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcf4070a70 con 0x7fbce00722d0 2024-09-12T02:35:18.953 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:35:18.953 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:35:18.954 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:35:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fbce00722d0 msgr2=0x7fbce0074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.153:6816/3440899718,v1:172.21.15.153:6817/3440899718] conn(0x7fbce00722d0 0x7fbce0074710 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbce006be30 msgr2=0x7fbce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fbce006be30 0x7fbce006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbce4034000 tx=0x7fbce402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 msgr2=0x7fbcf414fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 --2- 172.21.15.119:0/253001784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf415e7f0 0x7fbcf414fe90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00b9e0 tx=0x7fbcec00bea0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcf95cb640 1 -- 172.21.15.119:0/253001784 reap_dead start 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 shutdown_connections 2024-09-12T02:35:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 >> 172.21.15.119:0/253001784 conn(0x7fbcf40b3f30 msgr2=0x7fbcf40ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 shutdown_connections 2024-09-12T02:35:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:18.953+0000 7fbcfb02e640 1 -- 172.21.15.119:0/253001784 wait complete. 2024-09-12T02:35:18.965 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:35:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.064+0000 7f1dc872c640 1 Processor -- start 2024-09-12T02:35:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.064+0000 7f1dc872c640 1 -- start start 2024-09-12T02:35:19.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc872c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc872c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1dc006df60 0x7f1dc009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc872c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc006cec0 con 0x7f1dc00d1630 2024-09-12T02:35:19.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc872c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc006dad0 con 0x7f1dc006df60 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc872c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc006d1a0 con 0x7f1dc015e5d0 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc64c8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc5cc7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1dc006df60 0x7f1dc009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc6cc9640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1dc00d1630 0x7f1dc0162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.119:35506/0 (socket says 172.21.15.119:35506) 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.065+0000 7f1dc6cc9640 1 -- 172.21.15.119:0/1716053034 learned_addr learned my addr 172.21.15.119:0/1716053034 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc5cc7640 1 -- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 msgr2=0x7f1dc00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:19.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc5cc7640 1 --2- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc5cc7640 1 -- 172.21.15.119:0/1716053034 >> v1:172.21.15.153:6789/0 conn(0x7f1dc00d1630 legacy=0x7f1dc0162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc54c6640 1 -- 172.21.15.119:0/1716053034 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344801023 0 0) 0x7f1dc006cec0 con 0x7f1dc00d1630 2024-09-12T02:35:19.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc5cc7640 1 -- 172.21.15.119:0/1716053034 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc006d480 con 0x7f1dc006df60 2024-09-12T02:35:19.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.066+0000 7f1dc5cc7640 1 --2- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc006df60 0x7f1dc009aa30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1db00097a0 tx=0x7f1db002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1264cecee6f8095b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc54c6640 1 -- 172.21.15.119:0/1716053034 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0037070 con 0x7f1dc006df60 2024-09-12T02:35:19.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc54c6640 1 -- 172.21.15.119:0/1716053034 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0032440 con 0x7f1dc006df60 2024-09-12T02:35:19.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc54c6640 1 -- 172.21.15.119:0/1716053034 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0032810 con 0x7f1dc006df60 2024-09-12T02:35:19.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 -- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc006df60 msgr2=0x7f1dc009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 --2- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc006df60 0x7f1dc009aa30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1db00097a0 tx=0x7f1db002a210 comp rx=0 tx=0).stop 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 -- 172.21.15.119:0/1716053034 shutdown_connections 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 --2- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc006df60 0x7f1dc009aa30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 --2- 172.21.15.119:0/1716053034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 -- 172.21.15.119:0/1716053034 >> 172.21.15.119:0/1716053034 conn(0x7f1dc00d23a0 msgr2=0x7f1dc00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 -- 172.21.15.119:0/1716053034 shutdown_connections 2024-09-12T02:35:19.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.067+0000 7f1dc872c640 1 -- 172.21.15.119:0/1716053034 wait complete. 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.068+0000 7f1dc872c640 1 Processor -- start 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.068+0000 7f1dc872c640 1 -- start start 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc00d1630 0x7f1dc00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc015eb30 con 0x7f1dc006df60 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc015e9b0 con 0x7f1dc00d1630 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc872c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc009af70 con 0x7f1dc015e5d0 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39178/0 (socket says 172.21.15.119:39178) 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 -- 172.21.15.119:0/3991928174 learned_addr learned my addr 172.21.15.119:0/3991928174 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc5cc7640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc00d1630 0x7f1dc00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc6cc9640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 -- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 msgr2=0x7f1dc00b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 -- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc00d1630 msgr2=0x7f1dc00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc00d1630 0x7f1dc00b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.069+0000 7f1dc64c8640 1 -- 172.21.15.119:0/3991928174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc00b8060 con 0x7f1dc006df60 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1dc64c8640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e870 tx=0x7f1dbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc017070 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00c940 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc00c60e0 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cd30 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.070+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc00c66a0 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.071+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc009aa30 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.071+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1dbc01a070 con 0x7f1dc006df60 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.072+0000 7f1db6ffd640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 0x7f1da406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.072+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f1dbc08aba0 con 0x7f1dc006df60 2024-09-12T02:35:19.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.072+0000 7f1dc5cc7640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 0x7f1da406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.072+0000 7f1dc5cc7640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 0x7f1da406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.076+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1dc00b8060 con 0x7f1dc006df60 2024-09-12T02:35:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.242+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f1dc0070cc0 con 0x7f1da406be30 2024-09-12T02:35:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.243+0000 7f1db6ffd640 1 -- 172.21.15.119:0/3991928174 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1dc0070cc0 con 0x7f1da406be30 2024-09-12T02:35:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:35:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 msgr2=0x7f1da406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 0x7f1da406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 msgr2=0x7f1dc01531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e870 tx=0x7f1dbc00ed30 comp rx=0 tx=0).stop 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 shutdown_connections 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f1da406be30 0x7f1da406e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1dc015e5d0 0x7f1dc00b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dc00d1630 0x7f1dc00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 --2- 172.21.15.119:0/3991928174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc006df60 0x7f1dc01531d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 >> 172.21.15.119:0/3991928174 conn(0x7f1dc00d23a0 msgr2=0x7f1dc00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 shutdown_connections 2024-09-12T02:35:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.245+0000 7f1dc872c640 1 -- 172.21.15.119:0/3991928174 wait complete. 2024-09-12T02:35:19.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:19.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.353+0000 7fce74aba640 1 Processor -- start 2024-09-12T02:35:19.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.353+0000 7fce74aba640 1 -- start start 2024-09-12T02:35:19.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce74aba640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce700afd70 0x7fce70160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce74aba640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce700ce660 0x7fce700b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce74aba640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce70160d60 con 0x7fce700b5f80 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce74aba640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fce700b6910 con 0x7fce700afd70 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce74aba640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fce7006fdb0 con 0x7fce700ce660 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce6e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce700afd70 0x7fce70160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce6e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce700afd70 0x7fce70160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39182/0 (socket says 172.21.15.119:39182) 2024-09-12T02:35:19.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce6e59c640 1 -- 172.21.15.119:0/3819532708 learned_addr learned my addr 172.21.15.119:0/3819532708 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.354+0000 7fce6ed9d640 1 --2- 172.21.15.119:0/3819532708 >> v2:172.21.15.153:3300/0 conn(0x7fce700ce660 0x7fce700b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6e59c640 1 -- 172.21.15.119:0/3819532708 >> v2:172.21.15.153:3300/0 conn(0x7fce700ce660 msgr2=0x7fce700b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6e59c640 1 --2- 172.21.15.119:0/3819532708 >> v2:172.21.15.153:3300/0 conn(0x7fce700ce660 0x7fce700b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6e59c640 1 -- 172.21.15.119:0/3819532708 >> v1:172.21.15.153:6789/0 conn(0x7fce700b5f80 legacy=0x7fce7006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6e59c640 1 -- 172.21.15.119:0/3819532708 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce70070090 con 0x7fce700afd70 2024-09-12T02:35:19.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6e59c640 1 --2- 172.21.15.119:0/3819532708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce70160820 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce70067ea0 tx=0x7fce6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b227a255c7ad99a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.355+0000 7fce6d59a640 1 -- 172.21.15.119:0/3819532708 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60037070 con 0x7fce700afd70 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce6d59a640 1 -- 172.21.15.119:0/3819532708 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60032440 con 0x7fce700afd70 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce6d59a640 1 -- 172.21.15.119:0/3819532708 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60032810 con 0x7fce700afd70 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 -- 172.21.15.119:0/3819532708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 msgr2=0x7fce70160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 --2- 172.21.15.119:0/3819532708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce70160820 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce70067ea0 tx=0x7fce6002a270 comp rx=0 tx=0).stop 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 -- 172.21.15.119:0/3819532708 shutdown_connections 2024-09-12T02:35:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 --2- 172.21.15.119:0/3819532708 >> v2:172.21.15.153:3300/0 conn(0x7fce700ce660 0x7fce700b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 --2- 172.21.15.119:0/3819532708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce70160820 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 -- 172.21.15.119:0/3819532708 >> 172.21.15.119:0/3819532708 conn(0x7fce7006bc10 msgr2=0x7fce7006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 -- 172.21.15.119:0/3819532708 shutdown_connections 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.356+0000 7fce74aba640 1 -- 172.21.15.119:0/3819532708 wait complete. 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.357+0000 7fce74aba640 1 Processor -- start 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 -- start start 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 0x7fce70154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 0x7fce701570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce7006fa80 con 0x7fce700afd70 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce70070650 con 0x7fce700b5f80 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce74aba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce700b0150 con 0x7fce700ce660 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce6e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce6e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39198/0 (socket says 172.21.15.119:39198) 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.358+0000 7fce6e59c640 1 -- 172.21.15.119:0/2996907715 learned_addr learned my addr 172.21.15.119:0/2996907715 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6ed9d640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 0x7fce701570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6dd9b640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 0x7fce70154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 -- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 msgr2=0x7fce701570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 0x7fce701570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 -- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 msgr2=0x7fce70154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 0x7fce70154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 -- 172.21.15.119:0/2996907715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7015b2e0 con 0x7fce700afd70 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6ed9d640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 0x7fce701570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6dd9b640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 0x7fce70154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce6e59c640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce6002a2b0 tx=0x7fce600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60037040 con 0x7fce700afd70 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60042070 con 0x7fce700afd70 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7015b5c0 con 0x7fce700afd70 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60030880 con 0x7fce700afd70 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.359+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7015bb80 con 0x7fce700afd70 2024-09-12T02:35:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.360+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce70160060 con 0x7fce700afd70 2024-09-12T02:35:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.360+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce60030a20 con 0x7fce700afd70 2024-09-12T02:35:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.361+0000 7fce5effd640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.361+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fce600ab510 con 0x7fce700afd70 2024-09-12T02:35:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.361+0000 7fce6dd9b640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.361+0000 7fce6dd9b640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 0x7fce5006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce701f5640 tx=0x7fce64009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.365+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce6007a0c0 con 0x7fce700afd70 2024-09-12T02:35:19.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.528+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce70067fc0 con 0x7fce5006be30 2024-09-12T02:35:19.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.528+0000 7fce5effd640 1 -- 172.21.15.119:0/2996907715 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13444 (secure 0 0 0) 0x7fce70067fc0 con 0x7fce5006be30 2024-09-12T02:35:19.529 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:19.530 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.530+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 msgr2=0x7fce5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.530+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 0x7fce5006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce701f5640 tx=0x7fce64009040 comp rx=0 tx=0).stop 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.530+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 msgr2=0x7fce7014f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.530+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce6002a2b0 tx=0x7fce600046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 shutdown_connections 2024-09-12T02:35:19.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce700ce660 0x7fce701570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce700b5f80 0x7fce70154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 --2- 172.21.15.119:0/2996907715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce700afd70 0x7fce7014f260 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 >> 172.21.15.119:0/2996907715 conn(0x7fce7006bc10 msgr2=0x7fce700b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 shutdown_connections 2024-09-12T02:35:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:19.531+0000 7fce74aba640 1 -- 172.21.15.119:0/2996907715 wait complete. 2024-09-12T02:35:19.543 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-12T02:35:19.195408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221276,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753444,"statfs":{"total":773094113280,"available":772867526656,"internally_reserved":0,"allocated":5152768,"data_stored":2900752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.731598"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:35:12.194672+0000","last_change":"2024-09-12T02:33:50.615543+0000","last_active":"2024-09-12T02:35:12.194672+0000","last_peered":"2024-09-12T02:35:12.194672+0000","last_clean":"2024-09-12T02:35:12.194672+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:35:12.194672+0000","last_undegraded":"2024-09-12T02:35:12.194672+0000","last_fullsized":"2024-09-12T02:35:12.194672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:49.363803+0000","last_clean_scrub_stamp":"2024-09-12T02:33:49.363803+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:58.530945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476759,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":805370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":805370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:19.545 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T02:33:49.363803+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=33, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=35, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:35:19.546 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:35:29.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:29.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:39.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.657+0000 7fdf5fa8d640 1 Processor -- start 2024-09-12T02:35:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.657+0000 7fdf5fa8d640 1 -- start start 2024-09-12T02:35:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5fa8d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf58072320 0x7fdf580cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5fa8d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf58146140 con 0x7fdf5815e1f0 2024-09-12T02:35:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5fa8d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5806eed0 con 0x7fdf58072de0 2024-09-12T02:35:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5fa8d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdf580cd740 con 0x7fdf58072320 2024-09-12T02:35:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5e02a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdf5815e1f0 0x7fdf5806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50364/0 (socket says 172.21.15.119:50364) 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.658+0000 7fdf5e02a640 1 -- 172.21.15.119:0/1727308960 learned_addr learned my addr 172.21.15.119:0/1727308960 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d829640 1 --2- 172.21.15.119:0/1727308960 >> v2:172.21.15.153:3300/0 conn(0x7fdf58072320 0x7fdf580cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079895313 0 0) 0x7fdf58146140 con 0x7fdf5815e1f0 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf44003520 con 0x7fdf5815e1f0 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2882315838 0 0) 0x7fdf44003520 con 0x7fdf5815e1f0 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 >> v2:172.21.15.153:3300/0 conn(0x7fdf58072320 msgr2=0x7fdf580cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 --2- 172.21.15.119:0/1727308960 >> v2:172.21.15.153:3300/0 conn(0x7fdf58072320 0x7fdf580cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 >> v1:172.21.15.153:6789/0 conn(0x7fdf58072de0 legacy=0x7fdf5806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580cda20 con 0x7fdf5815e1f0 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7fdf500019f0 con 0x7fdf5815e1f0 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 >> v1:172.21.15.119:6789/0 conn(0x7fdf5815e1f0 legacy=0x7fdf5806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440039b0 0x7fdf44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 0x7fdf44004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf44005120 0x7fdf4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580cd740 con 0x7fdf440043b0 2024-09-12T02:35:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4400c060 con 0x7fdf440039b0 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4400c260 con 0x7fdf44005120 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 0x7fdf44004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d829640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440039b0 0x7fdf44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5e02a640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf44005120 0x7fdf4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 -- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf44005120 msgr2=0x7fdf4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf44005120 0x7fdf4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 -- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440039b0 msgr2=0x7fdf44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440039b0 0x7fdf44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5d028640 1 -- 172.21.15.119:0/1727308960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf44003520 con 0x7fdf440043b0 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5e02a640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf44005120 0x7fdf4400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.659+0000 7fdf5e02a640 1 -- 172.21.15.119:0/1727308960 reap_dead start 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.660+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 0x7fdf44004880 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001860 tx=0x7fdf44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc8de7e11ebccb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.660+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48037070 con 0x7fdf440043b0 2024-09-12T02:35:39.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.660+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4802abe0 con 0x7fdf440043b0 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.660+0000 7fdf5c827640 1 -- 172.21.15.119:0/1727308960 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48001430 con 0x7fdf440043b0 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 msgr2=0x7fdf44004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 0x7fdf44004880 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001860 tx=0x7fdf44005830 comp rx=0 tx=0).stop 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1727308960 shutdown_connections 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1727308960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf440043b0 0x7fdf44004880 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1727308960 >> 172.21.15.119:0/1727308960 conn(0x7fdf58067d70 msgr2=0x7fdf5806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1727308960 shutdown_connections 2024-09-12T02:35:39.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.661+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1727308960 wait complete. 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.662+0000 7fdf5fa8d640 1 Processor -- start 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.662+0000 7fdf5fa8d640 1 -- start start 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440043b0 0x7fdf581f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf580cb780 0x7fdf5813d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf58072700 con 0x7fdf580cb300 2024-09-12T02:35:39.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5815c9e0 con 0x7fdf440043b0 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5fa8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdf58072880 con 0x7fdf580cb780 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59668/0 (socket says 172.21.15.119:59668) 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 -- 172.21.15.119:0/1589045813 learned_addr learned my addr 172.21.15.119:0/1589045813 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5e02a640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf580cb780 0x7fdf5813d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d829640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440043b0 0x7fdf581f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 -- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf580cb780 msgr2=0x7fdf5813d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf580cb780 0x7fdf5813d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 -- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440043b0 msgr2=0x7fdf581f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440043b0 0x7fdf581f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.663+0000 7fdf5d028640 1 -- 172.21.15.119:0/1589045813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580c8a50 con 0x7fdf580cb300 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf5d028640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001980 tx=0x7fdf48001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48040020 con 0x7fdf580cb300 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf48038040 con 0x7fdf580cb300 2024-09-12T02:35:39.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf581f2ad0 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48037070 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.664+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf580c8fd0 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.665+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf580cce60 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.665+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf48043020 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.666+0000 7fdf4e7fc640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.666+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fdf480aa960 con 0x7fdf580cb300 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.666+0000 7fdf5d829640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.666+0000 7fdf5d829640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009c40 tx=0x7fdf54009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.670+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf4804a070 con 0x7fdf580cb300 2024-09-12T02:35:39.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.834+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 --> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf580c66e0 con 0x7fdf3c06be30 2024-09-12T02:35:39.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.835+0000 7fdf4e7fc640 1 -- 172.21.15.119:0/1589045813 <== mgr.4109 v2:172.21.15.119:6832/3796352012 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13358 (secure 0 0 0) 0x7fdf580c66e0 con 0x7fdf3c06be30 2024-09-12T02:35:39.836 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:39.837 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T02:35:39.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 msgr2=0x7fdf3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009c40 tx=0x7fdf54009190 comp rx=0 tx=0).stop 2024-09-12T02:35:39.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 msgr2=0x7fdf5813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001980 tx=0x7fdf48001230 comp rx=0 tx=0).stop 2024-09-12T02:35:39.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 shutdown_connections 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf580cb780 0x7fdf5813d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf580cb300 0x7fdf5813d0b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 --2- 172.21.15.119:0/1589045813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440043b0 0x7fdf581f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 >> 172.21.15.119:0/1589045813 conn(0x7fdf58067d70 msgr2=0x7fdf581453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 shutdown_connections 2024-09-12T02:35:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.837+0000 7fdf5fa8d640 1 -- 172.21.15.119:0/1589045813 wait complete. 2024-09-12T02:35:39.849 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-12T02:35:39.198875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221264,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753456,"statfs":{"total":773094113280,"available":772867538944,"internally_reserved":0,"allocated":5152768,"data_stored":2900752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002352"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":220,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:35:19.636023+0000","last_change":"2024-09-12T02:35:19.636057+0000","last_active":"2024-09-12T02:35:19.636023+0000","last_peered":"2024-09-12T02:35:19.636023+0000","last_clean":"2024-09-12T02:35:19.636023+0000","last_became_active":"2024-09-12T02:33:50.612792+0000","last_became_peered":"2024-09-12T02:33:50.612792+0000","last_unstale":"2024-09-12T02:35:19.636023+0000","last_undegraded":"2024-09-12T02:35:19.636023+0000","last_fullsized":"2024-09-12T02:35:19.636023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-09-12T02:35:19.635920+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-09-12T02:35:19.635920+0000","last_clean_scrub_stamp":"2024-09-12T02:35:19.635920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:25.867066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1089536,"data_stored":805370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1089536,"data_stored":805370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":215002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:39.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:35:39.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.947+0000 7fc6b27c6640 1 Processor -- start 2024-09-12T02:35:39.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.947+0000 7fc6b27c6640 1 -- start start 2024-09-12T02:35:39.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b27c6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 0x7fc6ac071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b27c6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6ac15b950 0x7fc6ac15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b27c6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac15be00 con 0x7fc6ac15b570 2024-09-12T02:35:39.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b27c6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac0740e0 con 0x7fc6ac15b950 2024-09-12T02:35:39.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b27c6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac073b20 con 0x7fc6ac0cd120 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6abfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc6ac15b570 0x7fc6ac0cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50372/0 (socket says 172.21.15.119:50372) 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6abfff640 1 -- 172.21.15.119:0/3322303195 learned_addr learned my addr 172.21.15.119:0/3322303195 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6b0d63640 1 --2- 172.21.15.119:0/3322303195 >> v2:172.21.15.153:3300/0 conn(0x7fc6ac15b950 0x7fc6ac15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/3322303195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 0x7fc6ac071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3322303195 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261502242 0 0) 0x7fc6ac15be00 con 0x7fc6ac15b570 2024-09-12T02:35:39.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3322303195 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc694003520 con 0x7fc6ac15b570 2024-09-12T02:35:39.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6ab7fe640 1 -- 172.21.15.119:0/3322303195 >> v2:172.21.15.153:3300/0 conn(0x7fc6ac15b950 msgr2=0x7fc6ac15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/3322303195 >> v2:172.21.15.153:3300/0 conn(0x7fc6ac15b950 0x7fc6ac15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6ab7fe640 1 -- 172.21.15.119:0/3322303195 >> v1:172.21.15.119:6789/0 conn(0x7fc6ac15b570 legacy=0x7fc6ac0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.948+0000 7fc6ab7fe640 1 -- 172.21.15.119:0/3322303195 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac073e00 con 0x7fc6ac0cd120 2024-09-12T02:35:39.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.949+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/3322303195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 0x7fc6ac071e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097a0 tx=0x7fc6a002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47eb1dc01a6ca85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.949+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3322303195 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0037070 con 0x7fc6ac0cd120 2024-09-12T02:35:39.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.949+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3322303195 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a002ae50 con 0x7fc6ac0cd120 2024-09-12T02:35:39.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.949+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3322303195 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0032640 con 0x7fc6ac0cd120 2024-09-12T02:35:39.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 -- 172.21.15.119:0/3322303195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 msgr2=0x7fc6ac071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/3322303195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 0x7fc6ac071e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097a0 tx=0x7fc6a002a100 comp rx=0 tx=0).stop 2024-09-12T02:35:39.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 -- 172.21.15.119:0/3322303195 shutdown_connections 2024-09-12T02:35:39.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/3322303195 >> v2:172.21.15.153:3300/0 conn(0x7fc6ac15b950 0x7fc6ac15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/3322303195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac0cd120 0x7fc6ac071e40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 -- 172.21.15.119:0/3322303195 >> 172.21.15.119:0/3322303195 conn(0x7fc6ac06bdf0 msgr2=0x7fc6ac06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 -- 172.21.15.119:0/3322303195 shutdown_connections 2024-09-12T02:35:39.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.950+0000 7fc6b27c6640 1 -- 172.21.15.119:0/3322303195 wait complete. 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.951+0000 7fc6b27c6640 1 Processor -- start 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.951+0000 7fc6b27c6640 1 -- start start 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac15b570 0x7fc6ac15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6ac15b950 0x7fc6ac15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0cf840 con 0x7fc6ac0cd120 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac072450 con 0x7fc6ac15b950 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b27c6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0cf9c0 con 0x7fc6ac15b570 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59688/0 (socket says 172.21.15.119:59688) 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 -- 172.21.15.119:0/1189558566 learned_addr learned my addr 172.21.15.119:0/1189558566 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac15b570 0x7fc6ac15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6b0d63640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6ac15b950 0x7fc6ac15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 -- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac15b570 msgr2=0x7fc6ac15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac15b570 0x7fc6ac15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 -- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6ac15b950 msgr2=0x7fc6ac15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6ac15b950 0x7fc6ac15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 -- 172.21.15.119:0/1189558566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac09a340 con 0x7fc6ac0cd120 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.952+0000 7fc6abfff640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00c460 tx=0x7fc69c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.953+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c017070 con 0x7fc6ac0cd120 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.953+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c005ce0 con 0x7fc6ac0cd120 2024-09-12T02:35:39.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.953+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac09a620 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.953+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c007290 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.953+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac09abe0 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.954+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac071e40 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.954+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc69c01a070 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.955+0000 7fc6a8ff9640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 0x7fc69806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.955+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fc69c08a0a0 con 0x7fc6ac0cd120 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.955+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 0x7fc69806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.955+0000 7fc6ab7fe640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 0x7fc69806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0034000 tx=0x7fc6a002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:39.959+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc69c0584e0 con 0x7fc6ac0cd120 2024-09-12T02:35:40.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.123+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc6ac0b3840 con 0x7fc6ac0cd120 2024-09-12T02:35:40.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.127+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fc69c05c7e0 con 0x7fc6ac0cd120 2024-09-12T02:35:40.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.128+0000 7fc6a8ff9640 1 -- 172.21.15.119:0/1189558566 <== mon.0 v2:172.21.15.119:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc69c0610a0 con 0x7fc6ac0cd120 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 msgr2=0x7fc69806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 0x7fc69806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0034000 tx=0x7fc6a002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 msgr2=0x7fc6ac09b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00c460 tx=0x7fc69c00c920 comp rx=0 tx=0).stop 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 shutdown_connections 2024-09-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7fc69806be60 0x7fc69806e320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6ac15b950 0x7fc6ac15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6ac15b570 0x7fc6ac15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 --2- 172.21.15.119:0/1189558566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac0cd120 0x7fc6ac09b3e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 >> 172.21.15.119:0/1189558566 conn(0x7fc6ac06bdf0 msgr2=0x7fc6ac0b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.129+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 shutdown_connections 2024-09-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.130+0000 7fc6b27c6640 1 -- 172.21.15.119:0/1189558566 wait complete. 2024-09-12T02:35:40.141 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:35:40.142 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:40.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.239+0000 7f53b02a5640 1 Processor -- start 2024-09-12T02:35:40.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.239+0000 7f53b02a5640 1 -- start start 2024-09-12T02:35:40.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53b02a5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53a815c520 0x7f53a809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53b02a5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f53a80b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53b02a5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a80cec00 con 0x7f53a80b1620 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53b02a5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f53a809bd90 con 0x7f53a815c520 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53b02a5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f53a80d0010 con 0x7f53a80d1090 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53ad840640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f53a80b1620 0x7f53a80d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50384/0 (socket says 172.21.15.119:50384) 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.240+0000 7f53ad840640 1 -- 172.21.15.119:0/3350132054 learned_addr learned my addr 172.21.15.119:0/3350132054 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae041640 1 --2- 172.21.15.119:0/3350132054 >> v2:172.21.15.153:3300/0 conn(0x7f53a815c520 0x7f53a809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f53a80b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590580379 0 0) 0x7f53a80cec00 con 0x7f53a80b1620 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5394003520 con 0x7f53a80b1620 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2162813273 0 0) 0x7f5394003520 con 0x7f53a80b1620 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 msgr2=0x7f53a80b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f53a80b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 >> v2:172.21.15.153:3300/0 conn(0x7f53a815c520 msgr2=0x7f53a809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 --2- 172.21.15.119:0/3350132054 >> v2:172.21.15.153:3300/0 conn(0x7f53a815c520 0x7f53a809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a80d02f0 con 0x7f53a80b1620 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1476536147 0 0) 0x7f5398001670 con 0x7f53a80b1620 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 >> v1:172.21.15.119:6789/0 conn(0x7f53a80b1620 legacy=0x7f53a80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53940039b0 0x7f5394003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f5394004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5394004d40 0x7f53940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53a809bd90 con 0x7f5394004d40 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53a80d0010 con 0x7f53940039b0 2024-09-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f539400b9c0 con 0x7f53a80d1090 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5394004d40 0x7f53940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae041640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53940039b0 0x7f5394003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ad840640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f5394004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 -- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 msgr2=0x7f5394004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80d1090 0x7f5394004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 -- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53940039b0 msgr2=0x7f5394003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53940039b0 0x7f5394003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.241+0000 7f53ae842640 1 -- 172.21.15.119:0/3350132054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5394003520 con 0x7f5394004d40 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.242+0000 7f53ae842640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5394004d40 0x7f53940051c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53a000e170 tx=0x7f5394005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6481e872878177f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.242+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0034020 con 0x7f5394004d40 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.242+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f53a00305f0 con 0x7f5394004d40 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.242+0000 7f53ad03f640 1 -- 172.21.15.119:0/3350132054 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0009c10 con 0x7f5394004d40 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 -- 172.21.15.119:0/3350132054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5394004d40 msgr2=0x7f53940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 --2- 172.21.15.119:0/3350132054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5394004d40 0x7f53940051c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53a000e170 tx=0x7f5394005830 comp rx=0 tx=0).stop 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53ae842640 1 -- 172.21.15.119:0/3350132054 reap_dead start 2024-09-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 -- 172.21.15.119:0/3350132054 shutdown_connections 2024-09-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 -- 172.21.15.119:0/3350132054 >> 172.21.15.119:0/3350132054 conn(0x7f53a80d23a0 msgr2=0x7f53a80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 -- 172.21.15.119:0/3350132054 shutdown_connections 2024-09-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.243+0000 7f53b02a5640 1 -- 172.21.15.119:0/3350132054 wait complete. 2024-09-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.244+0000 7f53b02a5640 1 Processor -- start 2024-09-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.244+0000 7f53b02a5640 1 -- start start 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5394004d40 0x7f53a80c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80b2f30 0x7f53a80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53a815c900 con 0x7f53a8153520 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53a80d05d0 con 0x7f5394004d40 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53b02a5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f53a80c85e0 con 0x7f53a80b2f30 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59696/0 (socket says 172.21.15.119:59696) 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 -- 172.21.15.119:0/2128831880 learned_addr learned my addr 172.21.15.119:0/2128831880 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ae041640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5394004d40 0x7f53a80c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ae842640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80b2f30 0x7f53a80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 -- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80b2f30 msgr2=0x7f53a80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80b2f30 0x7f53a80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 -- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5394004d40 msgr2=0x7f53a80c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5394004d40 0x7f53a80c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 -- 172.21.15.119:0/2128831880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a80b5370 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.245+0000 7f53ad840640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53980072f0 tx=0x7f53980076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.246+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539801a070 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.246+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f539800f960 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.246+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a80b60f0 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.246+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539800fd50 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.246+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a80b58f0 con 0x7f53a8153520 2024-09-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.247+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a809b720 con 0x7f53a8153520 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.247+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f539801d070 con 0x7f53a8153520 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.247+0000 7f539effd640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 0x7f538c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.248+0000 7f53ae041640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 0x7f538c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.248+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f539808a690 con 0x7f53a8153520 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.248+0000 7f53ae041640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 0x7f538c06e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009bc0 tx=0x7f53a4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.252+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5398058bf0 con 0x7f53a8153520 2024-09-12T02:35:40.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.452+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53a80b8320 con 0x7f53a8153520 2024-09-12T02:35:40.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.453+0000 7f539effd640 1 -- 172.21.15.119:0/2128831880 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3917 (secure 0 0 0) 0x7f539805cef0 con 0x7f53a8153520 2024-09-12T02:35:40.454 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:35:40.454 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"btime":"2024-09-12T02:35:09:460727+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2270484449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2270484449},{"type":"v1","addr":"172.21.15.153:6834","nonce":2270484449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/328714528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":328714528},{"type":"v1","addr":"172.21.15.119:6836","nonce":328714528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4842,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2833862820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2833862820},{"type":"v1","addr":"172.21.15.119:6837","nonce":2833862820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/357601217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":357601217},{"type":"v1","addr":"172.21.15.153:6835","nonce":357601217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-12T02:35:40.454 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 msgr2=0x7f538c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 0x7f538c06e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009bc0 tx=0x7f53a4009190 comp rx=0 tx=0).stop 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 msgr2=0x7f53a81f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53980072f0 tx=0x7f53980076f0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 shutdown_connections 2024-09-12T02:35:40.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:6832/3796352012,v1:172.21.15.119:6833/3796352012] conn(0x7f538c06be60 0x7f538c06e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53a80b2f30 0x7f53a80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8153520 0x7f53a81f6570 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 --2- 172.21.15.119:0/2128831880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5394004d40 0x7f53a80c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 >> 172.21.15.119:0/2128831880 conn(0x7f53a80d23a0 msgr2=0x7f53a80d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 shutdown_connections 2024-09-12T02:35:40.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:35:40.455+0000 7f53b02a5640 1 -- 172.21.15.119:0/2128831880 wait complete. 2024-09-12T02:35:40.466 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T02:35:40.467 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:35:40.467 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:35:40.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.476 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:35:40.476 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:35:40.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.526 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:35:40.526 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:35:40.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.538 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:35:40.539 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:35:40.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.591 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:35:40.591 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:35:40.591 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:35:40.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.616 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:35:40.616 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:35:40.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.682 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:35:40.682 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:35:40.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.746 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:35:40.747 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:35:40.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.817 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:35:40.818 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:35:40.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.853 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:35:40.853 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:35:40.853 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.932 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:35:40.932 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:35:40.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.007 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:35:41.008 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:35:41.008 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.078 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:35:41.078 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:35:41.079 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:35:41.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.106 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:35:41.106 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:35:41.106 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.152 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:35:41.152 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:35:41.152 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:35:41.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.163 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:35:41.163 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:35:41.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.204 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:35:41.205 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:35:41.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:41.256 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:35:41.257 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:35:41.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T02:35:41.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:41.296 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:35:41.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:41.504 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:35:41.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:41.586 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:35:41.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:41.643 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:35:41.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:35:41.711 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:35:41.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:35:41.836 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:35:41.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:35:41.923 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:35:41.981 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:35:41.981 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:35:42.037 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:35:42.039 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/data/mon.a.tgz 2024-09-12T02:35:42.039 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T02:35:42.055 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.yMh9MvdYmJ 2024-09-12T02:35:42.055 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yMh9MvdYmJ 2024-09-12T02:35:42.186 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.yMh9MvdYmJ 2024-09-12T02:35:42.270 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.yMh9MvdYmJ is 292KB 2024-09-12T02:35:42.337 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.yMh9MvdYmJ 2024-09-12T02:35:42.352 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/data/mon.b.tgz 2024-09-12T02:35:42.352 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T02:35:42.371 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.slCAaRGqLz 2024-09-12T02:35:42.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.slCAaRGqLz 2024-09-12T02:35:42.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.slCAaRGqLz 2024-09-12T02:35:42.613 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.slCAaRGqLz is 395KB 2024-09-12T02:35:42.711 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.slCAaRGqLz 2024-09-12T02:35:42.726 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/data/mon.c.tgz 2024-09-12T02:35:42.726 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T02:35:42.781 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.dvG6Tb2r7U 2024-09-12T02:35:42.781 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dvG6Tb2r7U 2024-09-12T02:35:42.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.dvG6Tb2r7U 2024-09-12T02:35:42.998 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.dvG6Tb2r7U is 395KB 2024-09-12T02:35:43.094 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.dvG6Tb2r7U 2024-09-12T02:35:43.109 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:35:43.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:35:43.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:35:43.194 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:35:43.229 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:35:43.229 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:35:43.231 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi119/crash 2024-09-12T02:35:43.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:35:43.260 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi153/crash 2024-09-12T02:35:43.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:35:43.293 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T02:35:43.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:43.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:43.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:43.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:43.435 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:35:43.435 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:35:43.453 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:35:43.475 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:35:43.475 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46256.log 2024-09-12T02:35:43.475 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2024-09-12T02:35:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42428.log 2024-09-12T02:35:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:35:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42828.log 2024-09-12T02:35:43.528 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42428.log.gz 2024-09-12T02:35:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-09-12T02:35:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.3.42828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-09-12T02:35:43.528 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42828.log.gz 2024-09-12T02:35:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36262.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T02:35:43.529 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-09-12T02:35:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36382.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:35:43.529 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-09-12T02:35:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:35:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36513.log 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42433.log 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36513.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9%/var/log/ceph/ceph-client.1.42433.log: -- replaced with /var/log/ceph/ceph-client.admin.36513.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42433.log.gz 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36467.log 2024-09-12T02:35:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36553.log 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0%/var/log/ceph/ceph-client.admin.36467.log: -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36467.log.gz 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36553.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36553.log.gz 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:35:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.d.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:35:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:35:43.544 INFO:teuthology.orchestra.run.smithi153.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T02:35:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42832.log 2024-09-12T02:35:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36302.log 2024-09-12T02:35:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.3.42832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42832.log.gz 2024-09-12T02:35:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36302.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36302.log.gz 2024-09-12T02:35:43.545 INFO:teuthology.orchestra.run.smithi153.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T02:35:43.579 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49250.log: /var/log/ceph/ceph-client.admin.42457.log: /var/log/ceph/ceph-client.admin.41835.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46256.log.gz 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2024-09-12T02:35:43.580 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49208.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42245.log 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47572.log 2024-09-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42245.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42245.log.gz 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45371.log 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47572.log.gz 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.45371.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2024-09-12T02:35:43.582 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45371.log.gz 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46077.log 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46077.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45817.log 2024-09-12T02:35:43.583 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46077.log.gz 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.2.45817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45817.log.gz 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gz 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-09-12T02:35:43.584 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42541.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44375.log 2024-09-12T02:35:43.585 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44375.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44039.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44375.log.gz 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46654.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-09-12T02:35:43.586 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36430.log 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46298.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36430.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36430.log.gz 2024-09-12T02:35:43.587 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45033.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42625.log 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49376.log 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42691.log: /var/log/ceph/ceph-client.admin.42625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42097.log 2024-09-12T02:35:43.588 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-09-12T02:35:43.589 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50659.log 2024-09-12T02:35:43.589 INFO:teuthology.orchestra.run.smithi119.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42625.log.gz 2024-09-12T02:35:43.589 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49376.log.gz 2024-09-12T02:35:43.589 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-09-12T02:35:43.589 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42097.log.gz 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46948.log 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50659.log: /var/log/ceph/ceph-client.admin.50801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50659.log.gz 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46948.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44366.log 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46948.log.gz 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46213.log: /var/log/ceph/ceph-client.admin.44366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-09-12T02:35:43.590 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44366.log.gz 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47954.log 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50365.log: /var/log/ceph/ceph-client.admin.44041.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.47404.log 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2024-09-12T02:35:43.591 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47954.log.gz 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36519.log 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47404.log: /var/log/ceph/ceph-client.admin.47870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36519.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2024-09-12T02:35:43.592 INFO:teuthology.orchestra.run.smithi119.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36519.log.gz 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44378.log: /var/log/ceph/ceph-client.admin.44040.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz --verbose 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/ceph-client.admin.42415.log 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48929.log 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48892.log: /var/log/ceph/ceph-client.admin.42415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2024-09-12T02:35:43.593 INFO:teuthology.orchestra.run.smithi119.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48929.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42415.log.gz 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42373.log 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48929.log.gz 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48604.log 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48080.log: /var/log/ceph/ceph-client.admin.42373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45376.log 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42373.log.gz 2024-09-12T02:35:43.594 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.48604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47530.log 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48604.log.gz 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.45376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45376.log.gz 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47530.log: -- /var/log/ceph/ceph-client.admin.49083.log 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43734.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47530.log.gz 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43566.log 2024-09-12T02:35:43.595 INFO:teuthology.orchestra.run.smithi119.stderr:gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz -- 2024-09-12T02:35:43.596 INFO:teuthology.orchestra.run.smithi119.stderr: /var/log/ceph/ceph-client.admin.43608.log 2024-09-12T02:35:43.596 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49083.log: /var/log/ceph/ceph-client.admin.43566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2024-09-12T02:35:43.596 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49083.log.gz 2024-09-12T02:35:43.596 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43608.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43566.log.gz 2024-09-12T02:35:43.596 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43440.log 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50155.log: /var/log/ceph/ceph-client.admin.48224.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-09-12T02:35:43.597 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43440.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44028.log 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43440.log.gz 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41931.log 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44028.log: /var/log/ceph/ceph-client.admin.41931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz 2024-09-12T02:35:43.598 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41931.log.gz 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44377.log 2024-09-12T02:35:43.599 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50113.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43860.log 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44377.log.gz 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49046.log: /var/log/ceph/ceph-client.admin.43860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-09-12T02:35:43.600 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46409.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43860.log.gz 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-09-12T02:35:43.601 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47702.log: /var/log/ceph/ceph-client.admin.43305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47116.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49502.log 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2024-09-12T02:35:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44700.log: /var/log/ceph/ceph-client.admin.49502.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49987.log 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49502.log.gz 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47074.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41743.log 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.a.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49987.log.gz 2024-09-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49009.log 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.41743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41743.log.gz 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49009.log: /var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2024-09-12T02:35:43.604 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48266.log 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46990.log: /var/log/ceph/ceph-client.admin.48266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48038.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48266.log.gz 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45813.log 2024-09-12T02:35:43.605 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44370.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.2.45813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45813.log.gz 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45950.log 2024-09-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44368.log: /var/log/ceph/ceph-client.admin.45950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45950.log.gz 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2024-09-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-09-12T02:35:43.608 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.a.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-09-12T02:35:43.608 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2024-09-12T02:35:43.608 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2024-09-12T02:35:43.608 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2024-09-12T02:35:43.608 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42055.log 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48308.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44029.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42055.log.gz 2024-09-12T02:35:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49628.log 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48164.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47744.log 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-09-12T02:35:43.610 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49628.log.gz 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47744.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47744.log.gz 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49903.log 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49544.log: /var/log/ceph/ceph-client.admin.49903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2024-09-12T02:35:43.611 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49903.log.gz 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47446.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45992.log 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50617.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz /var/log/ceph/ceph-client.admin.47786.log 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T02:35:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45992.log.gz 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47786.log.gz 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48416.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-09-12T02:35:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2%/var/log/ceph/ceph-client.admin.42203.log: -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-09-12T02:35:43.614 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42013.log 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42013.log.gz 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46034.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44033.log 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46864.log 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44033.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48350.log 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44033.log.gz 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30121.log 2024-09-12T02:35:43.616 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46864.log: /var/log/ceph/ceph-client.admin.48350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.tmp-client.admin.30121.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30121.log.gz 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48350.log.gz 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/ceph-client.admin.47658.log 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2024-09-12T02:35:43.617 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0%/var/log/ceph/ceph-client.admin.49861.log: -- replaced with /var/log/ceph/ceph-client.admin.47658.log.gz 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44826.log: /var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47828.log 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-09-12T02:35:43.618 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47828.log: -- /var/log/ceph/ceph-client.admin.43818.log 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47828.log.gz 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2024-09-12T02:35:43.619 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46906.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-09-12T02:35:43.620 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz/var/log/ceph/ceph-client.admin.50281.log: 2024-09-12T02:35:43.620 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-09-12T02:35:43.620 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-09-12T02:35:43.620 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36165.log 2024-09-12T02:35:43.620 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50197.log: /var/log/ceph/ceph-client.admin.43363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49670.log 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48608.log 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49670.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36165.log.gz 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49334.log 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49670.log.gz 2024-09-12T02:35:43.621 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.48608.log: /var/log/ceph/ceph-client.admin.49334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48608.log.gz 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50323.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49334.log.gz 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49460.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50071.log 2024-09-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50071.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44373.log 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50071.log.gz 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48788.log 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz/var/log/ceph/ceph-client.admin.44373.log: 2024-09-12T02:35:43.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47196.log: 87.7%gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/ceph-client.admin.47912.log 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44373.log.gz 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46487.log 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46487.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T02:35:43.624 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46487.log.gz 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44037.log: /var/log/ceph/ceph-osd.3.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.47032.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2024-09-12T02:35:43.625 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46822.log 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42331.log: /var/log/ceph/ceph-client.admin.46822.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42141.log 2024-09-12T02:35:43.626 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43131.log 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44658.log: /var/log/ceph/ceph-client.admin.42141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42141.log.gzgzip 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43131.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.43131.log.gz 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43692.log 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49292.log 2024-09-12T02:35:43.627 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46696.log: /var/log/ceph/ceph-client.admin.43692.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-09-12T02:35:43.628 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz 2024-09-12T02:35:43.628 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49292.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49292.log.gz 2024-09-12T02:35:43.628 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:35:43.629 INFO:teuthology.orchestra.run.smithi153.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:35:43.629 INFO:teuthology.orchestra.run.smithi153.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:35:43.665 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:35:44.103 INFO:teuthology.orchestra.run.smithi119.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi119.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi153.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:35:44.156 INFO:teuthology.orchestra.run.smithi119.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m0.706s 2024-09-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m2.707s 2024-09-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.145s 2024-09-12T02:35:44.223 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.760s 2024-09-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m2.763s 2024-09-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.207s 2024-09-12T02:35:44.226 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:35:44.226 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi119/log 2024-09-12T02:35:44.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:35:45.453 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi153/log 2024-09-12T02:35:45.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:35:45.864 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:35:45.873 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:35:45.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:35:45.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:35:45.960 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:35:45.969 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:35:45.970 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:35:45.973 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:35:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:35:45.990 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:35:45.992 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:35:45.993 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-12T02:35:45.993 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -3434us[-3432us] +/- 64ms 2024-09-12T02:35:45.993 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +1065us[+1067us] +/- 75ms 2024-09-12T02:35:45.993 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +2966us[+2968us] +/- 74ms 2024-09-12T02:35:45.993 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:35:45.996 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:35:45.996 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-12T02:35:45.996 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 -3432us[-3424us] +/- 64ms 2024-09-12T02:35:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +1073us[+1073us] +/- 75ms 2024-09-12T02:35:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +2967us[+2975us] +/- 74ms 2024-09-12T02:35:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:35:45.997 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:35:46.009 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:35:46.009 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:35:46.017 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:35:46.107 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:35:46.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:35:46.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:46.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:35:46.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:46.239 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:35:46.249 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:35:46.258 INFO:teuthology.task.internal:Duration was 498.412282 seconds 2024-09-12T02:35:46.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:35:46.269 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:35:46.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:35:46.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:35:46.312 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:35:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:35:46.690 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:35:46.690 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:35:46.691 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:35:46.754 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T02:35:46.754 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:35:46.785 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:35:46.785 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:35:46.797 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:35:46.856 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:35:46.857 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:35:46.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:35:47.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:35:47.012 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:35:47.012 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:35:47.037 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:35:47.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:35:47.074 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:35:47.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:35:47.100 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-12T02:35:47.125 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-12T02:35:47.139 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:35:47.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:47.168 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:35:47.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:47.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:35:47.204 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:35:47.205 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi119 2024-09-12T02:35:47.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:35:47.246 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901628/remote/smithi153 2024-09-12T02:35:47.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:35:47.279 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:35:47.279 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:35:47.282 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:35:47.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:35:47.341 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:35:47.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:35:47.351 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:35:47.351 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:35:47.354 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:35:47.366 INFO:teuthology.orchestra.run.smithi119.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:35 /home/ubuntu/cephtest 2024-09-12T02:35:47.383 INFO:teuthology.orchestra.run.smithi153.stdout: 265815 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:35 /home/ubuntu/cephtest 2024-09-12T02:35:47.384 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:35:47.394 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:35:47.418 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-flush} duration: 498.41228222846985 failure_reason: 'Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=33e9f359d48241d08072ed89e0ac0b63 status: fail success: false 2024-09-12T02:35:47.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:35:47.531 INFO:teuthology.run:FAIL